-- Logs begin at Fri 2022-06-24 09:56:55 UTC, end at Fri 2022-06-24 10:57:02 UTC. -- Jun 24 10:27:03.771850 dv-cinder-847536-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 10:27:03.780971 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:27:03 2022] *** Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: nodename: dv-cinder-847536-1-iscsi Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: machine: x86_64 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: clock source: unix Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: pcre jit disabled Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: detected number of CPU cores: 4 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: current working directory: / Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: your processes number limit is 47680 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: your memory page size is 4096 bytes Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: detected max file descriptor number: 2048 Jun 24 10:27:03.783384 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: lock engine: pthread robust mutexes Jun 24 10:27:03.784784 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: thunder lock: enabled Jun 24 10:27:03.784784 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 10:27:03.784784 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:27:03.827181 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: Python main interpreter initialized at 0x55b3b96459c0 Jun 24 10:27:03.827181 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: python threads support enabled Jun 24 10:27:03.827181 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: your server socket listen backlog is limited to 100 connections Jun 24 10:27:03.827181 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:27:03.827643 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:27:03.827643 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: *** Operational MODE: preforking *** Jun 24 10:27:03.827852 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:27:03.827852 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: spawned uWSGI master process (pid: 103339) Jun 24 10:27:03.828012 dv-cinder-847536-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 10:27:03.832759 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: spawned uWSGI worker 1 (pid: 103340, cores: 1) Jun 24 10:27:03.832759 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: spawned uWSGI worker 2 (pid: 103341, cores: 1) Jun 24 10:27:03.832759 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:27:04.473694 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:27:04.480374 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:27:05.582433 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:27:05.582433 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Jun 24 10:27:05.583069 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:27:05.583069 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Jun 24 10:27:05.583455 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:27:05.583455 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Jun 24 10:27:05.583565 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:27:05.583565 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Jun 24 10:27:08.027209 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:27:08.027808 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:27:08.027975 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:27:08.028331 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:27:08.028579 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:27:08.028986 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.029266 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:27:08.029692 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.029780 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:27:08.029857 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.029857 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.029993 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:27:08.030218 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.030349 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:27:08.030524 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.030674 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:27:08.030852 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031012 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031148 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031295 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031470 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031584 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031734 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.031884 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032037 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032212 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032341 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-1-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032569 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032769 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.032940 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033229 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033331 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033529 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033615 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033801 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.033887 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034119 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034203 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034443 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034542 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-1-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034747 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.034841 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.035058 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.035235 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.035370 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036411 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036515 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036583 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036646 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036751 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036836 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036836 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036966 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.036966 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037085 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037203 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037404 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037543 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037710 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.037795 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038020 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038107 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038354 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038440 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038667 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038753 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-1-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.038977 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039076 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039297 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039382 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039602 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039696 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.039923 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040048 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040233 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040354 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040630 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-1-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040716 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.040973 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041074 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041285 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041371 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041588 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041672 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.041909 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042034 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042221 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042330 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042534 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042620 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042848 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.042942 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043144 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043229 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043450 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043541 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043753 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.043845 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044072 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044169 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044371 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044456 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044669 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044775 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.044942 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045038 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045246 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045331 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045563 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045655 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045880 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.045976 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046195 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046287 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046439 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046535 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046682 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046769 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.046995 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047093 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047308 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047415 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047615 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047711 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.047916 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048009 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048253 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048338 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048560 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048654 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.048909 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049000 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049231 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049317 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049532 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049625 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049837 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.049921 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050144 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050227 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050453 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050546 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050757 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.050851 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051067 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051153 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051376 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051543 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051702 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.051944 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052060 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052215 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052314 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052521 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052615 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052880 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.052970 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053198 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053298 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053504 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053630 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053819 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.053910 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054142 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054235 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054446 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054531 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054751 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.054835 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055054 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055149 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055367 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055452 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055695 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055779 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.055997 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056093 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056243 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056327 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056541 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056635 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056866 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.056986 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057182 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057281 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057483 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057578 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057759 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.057843 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058061 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058145 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058358 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058452 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058660 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058745 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.058962 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059046 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059264 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059355 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059569 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059659 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059870 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.059953 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060171 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060262 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060473 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060565 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060797 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.060894 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061105 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061197 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061409 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061499 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061713 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.061809 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062014 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062105 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062318 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062412 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062618 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062719 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.062960 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063055 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063233 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063326 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063531 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063616 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.063902 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064000 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064217 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064351 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064518 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064603 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064845 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.064952 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065158 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065249 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065460 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065550 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065762 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.065853 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066071 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066153 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066367 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066450 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066670 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066769 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.066974 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067056 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067274 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067357 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067575 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067667 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067874 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.067969 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068173 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068256 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068474 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068559 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068793 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.068878 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069177 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069392 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069476 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069688 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069779 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.069987 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070069 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070292 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070378 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070593 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070684 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070893 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.070976 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071191 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071274 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071502 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071596 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071818 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.071909 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.072125 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.072217 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.072431 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.072572 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.072761 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.072865 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.073077 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:27:08.073168 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.073403 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.073492 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.073715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.073818 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074028 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074113 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074335 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074419 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074652 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074749 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.074960 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075043 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075264 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075354 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075569 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075654 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075880 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.075965 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076192 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076275 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076503 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076589 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076835 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.076920 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077147 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077240 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077458 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077551 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077764 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.077857 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078075 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078162 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078389 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078474 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078699 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.078788 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079005 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079090 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079314 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079437 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079655 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079745 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.079964 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080049 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080287 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080372 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080598 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080681 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.080959 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081054 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081302 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081385 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081610 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081695 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.081927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082018 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082245 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082336 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082555 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082643 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082865 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.082965 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083171 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083255 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083480 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083571 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083789 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.083881 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.084094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.084177 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.084783 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.084876 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085091 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085182 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085398 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085482 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085706 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.085789 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086014 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086098 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086322 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086405 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086627 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086709 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.086934 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087019 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087237 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087319 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087535 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087621 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087834 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.087919 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088134 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088268 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088440 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088567 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088752 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.088884 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089068 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089198 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089373 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089516 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089674 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089804 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.089983 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090113 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090285 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090424 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090590 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090721 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.090894 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091029 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091201 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091356 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091488 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091619 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091796 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.091935 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092103 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092240 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092404 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092531 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092712 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.092860 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093044 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093137 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093344 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093427 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093650 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093733 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.093956 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094041 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094252 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094335 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094562 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094646 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094867 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.094951 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.095237 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.095333 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.095542 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.095710 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.095845 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096025 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096158 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096345 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096470 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096657 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096800 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.096993 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097112 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097325 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097410 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097652 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097784 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.097952 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098085 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098275 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098369 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098598 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098686 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098914 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.098998 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099214 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099306 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099520 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099604 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099822 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.099906 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100124 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100222 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100423 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100506 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100727 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.100840 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101049 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101143 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101349 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101433 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101649 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101733 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.101948 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102044 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102247 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102331 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102550 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102640 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102853 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.102945 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103154 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103237 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103452 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103536 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103756 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.103841 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104062 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104144 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104368 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104462 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104670 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104783 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.104998 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105084 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105341 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105425 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105642 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105726 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.105952 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106034 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106264 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106355 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106569 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106654 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106873 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.106964 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107178 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107269 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107484 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107575 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107796 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.107927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108098 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108192 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108407 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108533 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108710 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.108920 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109051 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109201 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109330 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109460 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109643 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109773 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.109941 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110083 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110254 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110385 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110568 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110695 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.110912 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111109 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111329 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111462 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111594 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111730 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111868 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.111997 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112156 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112288 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112474 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112561 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112814 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.112976 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113117 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113244 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113411 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113546 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113719 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.113846 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114025 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114151 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114332 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114465 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114634 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114780 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.114948 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115074 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115250 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115383 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115560 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115687 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115859 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.115993 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116167 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116304 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116474 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116610 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116820 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.116968 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117124 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117275 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117431 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117569 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117756 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.117888 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118045 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118180 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118350 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118476 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118658 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118795 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.118958 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119086 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119258 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119385 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119563 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119689 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119868 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.119995 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120170 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120303 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120473 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120605 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120815 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.120945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121096 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121223 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121399 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121530 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121698 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121836 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.121997 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122128 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122304 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122448 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122608 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122760 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.122913 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123053 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123213 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123348 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123525 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123656 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123829 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.123968 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124127 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124277 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124445 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124587 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124770 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.124895 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125082 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125187 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125371 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125467 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125671 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125758 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.125982 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.126069 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.126335 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.126436 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.126644 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.126877 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127047 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127131 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127282 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127385 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127594 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127687 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127900 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.127985 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128217 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128303 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128525 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128673 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128862 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.128991 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129181 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129320 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129491 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129631 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129800 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.129929 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130107 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130237 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130418 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130563 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130708 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.130838 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131024 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131328 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131429 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131636 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131720 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.131942 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132026 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132242 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132341 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132550 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132635 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132882 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.132968 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.133195 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.133449 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.133534 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.133785 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.133875 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.134098 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.134188 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.134413 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.134666 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.134751 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135003 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135087 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135322 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135413 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135646 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135730 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.135969 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136053 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136273 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136372 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136579 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136662 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136908 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.136994 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137210 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137307 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137521 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137614 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137824 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.137908 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138126 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138209 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138426 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138556 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138733 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.138818 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139033 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139118 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139331 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139423 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139631 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139715 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.139929 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140014 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140238 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140321 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140535 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140624 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140859 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.140958 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.141159 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.141243 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.141473 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.141554 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.141775 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142072 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142162 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142239 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142452 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142545 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142728 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.142821 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143041 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143135 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143346 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143433 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143651 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143744 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.143956 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144040 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144295 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144379 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144596 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144687 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.144922 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145009 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145244 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145336 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145543 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145629 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145845 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.145929 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146144 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146228 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146450 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146535 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146753 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.146837 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147053 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147145 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147353 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147443 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147654 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147745 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.147959 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148098 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148258 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148342 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148555 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148682 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148883 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.148980 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149180 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149263 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149485 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149568 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149787 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.149880 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150085 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150175 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150385 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150469 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150692 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150786 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.150997 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151083 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151295 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151378 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151595 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151687 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151892 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.151975 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152200 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152290 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152499 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152582 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152824 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.152912 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153128 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153220 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153435 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153528 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153736 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.153820 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154030 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154120 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154332 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154416 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154637 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154719 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.154937 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155029 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155236 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155320 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155539 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155630 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155836 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.155932 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156133 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156217 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156434 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156516 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156795 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.156896 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157064 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157155 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157362 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157445 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157733 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.157818 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158108 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158337 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158421 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158638 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158770 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.158945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159028 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159242 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159325 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159542 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159635 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159840 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.159925 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160140 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160223 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160437 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160529 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160756 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.160844 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161067 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161169 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161365 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161448 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161666 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161748 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.161963 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162055 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162280 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162362 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162584 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162670 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162890 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.162983 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163193 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163328 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163515 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163629 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163827 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.163926 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164130 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164224 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164435 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164522 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164752 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.164840 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165063 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165151 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165375 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165460 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165681 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165767 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.165986 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166079 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166286 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166372 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166586 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166682 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166893 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.166976 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167200 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167291 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167501 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167594 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167804 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.167889 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168118 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168209 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168427 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168519 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168726 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.168836 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169069 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169177 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169371 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169455 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169673 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169758 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.169978 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170072 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170284 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170370 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170591 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170674 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170894 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.170990 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171200 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171284 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171503 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171586 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171809 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.171915 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172110 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172195 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172414 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172500 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172720 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.172827 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173040 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173144 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173375 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173490 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173686 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173780 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.173985 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174077 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174288 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174371 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174583 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174676 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174887 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.174972 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175183 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175275 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175489 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175602 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175794 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.175909 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176102 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176200 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176407 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176500 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176820 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.176920 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177134 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177300 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177438 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177570 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177737 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.177865 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178033 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178172 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178340 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178470 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178657 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178790 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.178970 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179180 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179314 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179444 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179583 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.179875 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180010 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180172 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180313 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180493 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180620 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180814 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.180946 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181114 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181241 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181413 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181544 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181726 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.181868 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182008 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182139 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182322 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182454 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182623 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182753 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.182942 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183080 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183244 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183386 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183725 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.183975 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184069 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184285 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184379 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184590 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184681 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.184930 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185016 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185248 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185341 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185550 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185634 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185857 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.185946 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186161 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186268 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186478 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186574 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186795 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.186879 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187101 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187187 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187409 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187506 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187708 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.187792 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188024 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188116 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188332 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188415 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188634 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.188760 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189004 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189089 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189426 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189519 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189743 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.189830 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190048 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190132 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190363 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190455 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190681 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190824 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.190983 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191150 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191283 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191464 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191591 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191787 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.191892 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192114 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192202 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192421 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192513 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.192844 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193060 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193369 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193453 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193677 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193795 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.193979 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194063 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194276 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194362 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194591 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194682 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194885 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.194975 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195197 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195286 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195501 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195594 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195804 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.195888 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196116 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196200 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196415 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196513 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196728 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.196831 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197052 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197148 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197353 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197445 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197653 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197748 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.197955 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198042 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198274 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198370 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198580 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198663 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198882 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.198963 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199187 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199271 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199491 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199574 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199811 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.199893 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200123 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200206 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200445 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200534 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200776 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.200865 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201092 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201187 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201409 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201493 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201709 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.201799 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202008 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202133 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202312 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202397 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202612 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202709 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202911 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.202996 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203208 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203291 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203518 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203644 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203817 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.203941 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204116 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204201 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204443 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204540 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204782 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.204899 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205084 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205182 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205399 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205509 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205701 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.205805 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206003 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206105 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206303 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206399 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206603 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206697 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.206931 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207025 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207229 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207329 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207534 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207634 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207840 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.207943 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208146 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208240 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208470 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208571 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208798 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.208898 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.209120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.209207 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.209778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.209872 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210092 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210185 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210405 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210489 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.210798 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211027 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211120 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211339 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211424 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211650 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211741 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.211953 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212265 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212398 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212573 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212699 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.212911 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213009 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213230 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213426 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213544 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213747 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.213861 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214056 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214176 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214365 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214493 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214672 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.214981 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215073 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215288 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215374 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215593 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215677 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215899 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.215991 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216204 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216289 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216507 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216602 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216851 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.216949 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217168 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217253 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217482 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217575 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217796 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.217880 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218111 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218202 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218419 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218580 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218728 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.218813 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219039 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219131 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219385 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219469 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219695 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.219786 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220028 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220160 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220367 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220453 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220679 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.220788 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221013 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221105 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221321 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221411 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221627 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221718 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.221934 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222026 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222241 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222325 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222547 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222631 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222852 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.222949 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223159 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223244 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223472 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223556 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223787 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.223872 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224100 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224183 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224413 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224497 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224718 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.224831 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225053 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225136 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225364 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225446 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225697 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.225871 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226018 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226181 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226334 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226509 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226648 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226827 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.226967 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.227146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.227456 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.227548 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.227768 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.227851 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228086 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228171 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228384 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228480 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228681 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.228783 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229014 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229099 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229317 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229412 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229614 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229710 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.229937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230029 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230240 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230324 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230540 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230624 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230845 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.230927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.231149 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.231242 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.231471 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.231664 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.231779 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232008 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232105 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232320 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232456 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232640 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232724 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.232993 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.233234 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.233371 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.233565 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.233660 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.233882 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234046 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234178 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234312 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234476 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234611 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234787 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.234925 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235093 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235232 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235402 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235534 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235713 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235860 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.235998 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236132 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236336 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236472 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236611 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236811 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236899 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.236976 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237200 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237284 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237513 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237599 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237816 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.237907 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238114 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238206 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238411 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238496 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238715 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.238798 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239010 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239094 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239309 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239403 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239607 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239692 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239903 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.239987 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240208 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240301 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240508 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240599 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240835 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.240935 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241138 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241229 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241438 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241521 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241736 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.241828 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242034 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242178 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242341 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242426 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242642 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242744 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.242954 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243038 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243249 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243339 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243557 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243652 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243863 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.243946 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244178 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244271 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244482 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244574 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244812 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.244899 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245131 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245215 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245442 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245527 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245761 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.245957 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246073 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246283 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246380 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246596 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246713 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.246925 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247031 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247254 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247558 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247651 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247857 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.247976 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248156 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248249 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248476 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248560 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248818 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.248906 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249130 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249226 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249436 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249521 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249738 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.249821 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250041 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250141 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250347 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250439 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250650 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250734 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.250954 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251040 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251383 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251482 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251615 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251699 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.251924 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252009 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252239 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252324 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252549 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252680 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252884 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.252979 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253193 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253278 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253502 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253599 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253812 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.253896 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254120 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254204 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254430 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254525 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254735 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.254819 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255041 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255131 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255345 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255442 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255650 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255735 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.255961 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256044 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256276 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256368 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256583 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256666 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256908 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.256994 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257216 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257302 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257531 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257616 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257861 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.257945 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258176 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258269 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258483 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258567 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258800 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.258883 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259116 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259202 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259422 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259507 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259741 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.259832 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260049 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260133 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260372 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260463 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260703 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.260849 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261053 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261137 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261372 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261455 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261673 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261765 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.261975 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262061 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262273 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262357 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262579 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262672 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262894 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.262986 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263223 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263327 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263500 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263591 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263797 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.263881 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264103 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264191 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264402 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264560 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264704 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.264852 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265033 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265127 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265332 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265429 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265639 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265724 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.265937 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266029 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266234 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266318 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266534 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266625 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266831 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.266943 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.267161 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.267288 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.267465 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.267666 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.267771 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268041 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268126 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268345 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268428 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268651 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268800 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.268974 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269058 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269272 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269355 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269570 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269666 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269871 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.269956 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270172 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270256 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270478 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270572 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270779 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.270863 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271092 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271175 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271410 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271514 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271713 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.271798 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272026 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272110 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272334 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272419 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272641 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272724 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.272976 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273064 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273296 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273382 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273601 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273694 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273907 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.273992 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274216 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274300 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274521 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274652 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274823 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.274921 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275129 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275215 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275436 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275519 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275745 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.275905 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276042 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276126 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276349 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276431 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276656 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276782 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.276998 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277084 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277354 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277448 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277606 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277702 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.277928 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278020 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278237 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278321 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278540 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278632 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278848 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.278931 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279149 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279232 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279455 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279541 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279765 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.279856 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280075 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280167 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280389 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280474 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280698 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.280815 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281025 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281122 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281337 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281421 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281653 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281743 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.281975 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.282066 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.282285 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.282369 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.282681 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.282784 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283003 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283098 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283317 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283401 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283624 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283708 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.283926 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.284020 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.284164 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:27:08.284288 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.284605 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.284949 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.285258 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:27:08.285498 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:27:08.443591 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Registered counter for database nova_api Jun 24 10:27:08.444105 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Registered counter for database nova_api Jun 24 10:27:08.466780 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.468573 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.473601 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.475762 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.530956 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.context [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5c325af-f7fa-481f-b3fd-d4961ecadde3(cell1) {{(pid=103341) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:27:08.535041 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.536638 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.537599 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.539581 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.541667 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Registered counter for database nova_cell0 Jun 24 10:27:08.541803 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.context [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5c325af-f7fa-481f-b3fd-d4961ecadde3(cell1) {{(pid=103340) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:27:08.545828 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.545972 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Registered counter for database nova_cell1 Jun 24 10:27:08.547426 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.548255 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.550330 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.552416 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Registered counter for database nova_cell0 Jun 24 10:27:08.554703 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.556289 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.557110 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Registered counter for database nova_cell1 Jun 24 10:27:08.564040 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.565232 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.567399 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.569565 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.570210 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.730251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.735366 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Registered counter for database nova_cell0 Jun 24 10:27:08.741930 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Registered counter for database nova_cell0 Jun 24 10:27:08.743393 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.749749 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:27:08.750056 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:08.755289 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:27:09.102179 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:27:09.109690 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:27:09.123545 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:27:09.130979 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:27:09.458784 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:27:09.465188 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:27:09.470581 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3b96459c0 pid: 103340 (default app) Jun 24 10:27:09.472623 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:09.473843 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jun 24 10:27:09.474231 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Fri Jun 24 10:27:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:09.497427 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:27:09.503634 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-ddbb4498-e2e1-41cd-9122-1ed90afb8e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:27:09.508875 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3b96459c0 pid: 103341 (default app) Jun 24 10:28:24.905885 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:24.906896 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 24 10:28:24.907310 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:24.919486 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:24.920303 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:24.921215 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell1:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:24.922196 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:25.362306 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-deaf63b1-b492-419c-8ed2-4360323857ea admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:25.391602 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-deaf63b1-b492-419c-8ed2-4360323857ea admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477177 Jun 24 10:28:25.392356 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Jun 24 10:28:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:27.441174 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:27.442735 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d9a939eb-78ab-4db2-be72-3fff9081a101 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002340 Jun 24 10:28:27.445283 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:27.502771 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4d53aac9-6a90-405e-a58e-ef34f2f00d1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "id": "c1", "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:27.521193 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.521193 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Jun 24 10:28:27.551595 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-4d53aac9-6a90-405e-a58e-ef34f2f00d1b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102127 Jun 24 10:28:27.552167 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:28:27.766599 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6040066f-546d-4754-ac81-3c7e36a72afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:27.769197 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.769197 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:28:27.771909 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:27.772680 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:27.773550 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:27.774397 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:27.834982 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6040066f-546d-4754-ac81-3c7e36a72afa admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274529 Jun 24 10:28:27.835493 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Jun 24 10:28:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:29.870775 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4d53aac9-6a90-405e-a58e-ef34f2f00d1b admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:29.871802 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-4d53aac9-6a90-405e-a58e-ef34f2f00d1b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 24 10:28:29.872181 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:29.986899 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-30d51fb0-85f3-4383-8767-6ba82e81e3e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:30.004308 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:30.004308 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:28:30.023304 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-30d51fb0-85f3-4383-8767-6ba82e81e3e4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145200 Jun 24 10:28:30.023855 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:28:30.035989 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a841fe42-bad3-4554-94a6-9b5e68ec4808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:30.037526 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:30.037526 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Jun 24 10:28:30.069789 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a841fe42-bad3-4554-94a6-9b5e68ec4808 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037731 Jun 24 10:28:30.070364 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Jun 24 10:28:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:28:32.105177 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-30d51fb0-85f3-4383-8767-6ba82e81e3e4 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:32.106460 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-30d51fb0-85f3-4383-8767-6ba82e81e3e4 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Jun 24 10:28:32.107127 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:32.169287 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c743d1e4-1344-4720-92b2-de019c37ecfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:32.193670 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c743d1e4-1344-4720-92b2-de019c37ecfa admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079209 Jun 24 10:28:32.196806 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:32.207026 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4b070194-be6d-4e5c-8404-6ab9b1a44f6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:32.232024 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4b070194-be6d-4e5c-8404-6ab9b1a44f6c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028950 Jun 24 10:28:32.240811 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Jun 24 10:28:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:34.294476 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c743d1e4-1344-4720-92b2-de019c37ecfa admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:34.298099 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c743d1e4-1344-4720-92b2-de019c37ecfa admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004334 Jun 24 10:28:34.300915 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:34.371488 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bc8bdba5-86ea-43a8-8af0-cd6110d04b36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:34.389738 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bc8bdba5-86ea-43a8-8af0-cd6110d04b36 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082548 Jun 24 10:28:34.390884 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:34.403197 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-1c6ab5bc-f2a4-4b45-9208-67775f739cd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:34.427638 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-1c6ab5bc-f2a4-4b45-9208-67775f739cd1 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028337 Jun 24 10:28:34.428221 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Jun 24 10:28:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:36.497011 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bc8bdba5-86ea-43a8-8af0-cd6110d04b36 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:36.498039 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bc8bdba5-86ea-43a8-8af0-cd6110d04b36 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 24 10:28:36.498700 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:36.562785 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:36.581891 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076791 Jun 24 10:28:36.582458 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:28:36.594900 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d86a30dd-1a78-4a01-b622-e126a33b2557 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:36.620006 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d86a30dd-1a78-4a01-b622-e126a33b2557 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028873 Jun 24 10:28:36.620803 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Jun 24 10:28:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:28:38.678395 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:38.679410 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 24 10:28:38.679774 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:38.744234 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1320beaa-e55d-4328-844e-f82d89cbdd43 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:38.767754 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-1320beaa-e55d-4328-844e-f82d89cbdd43 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081636 Jun 24 10:28:38.768824 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Jun 24 10:28:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:28:40.841631 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:40.841631 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c9bcb471-15c8-4789-b5ef-52db453264bb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 24 10:28:40.841631 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:40.922290 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-fd30daf0-da2a-4178-8d22-f48e7e273bb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:40.943811 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-fd30daf0-da2a-4178-8d22-f48e7e273bb9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.096030 Jun 24 10:28:40.944472 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:40.957581 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9b2711cf-f6b8-413e-afa1-a1de3c18d469 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:40.983785 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9b2711cf-f6b8-413e-afa1-a1de3c18d469 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029934 Jun 24 10:28:40.984289 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Jun 24 10:28:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:43.027525 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-fd30daf0-da2a-4178-8d22-f48e7e273bb9 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:43.028825 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-fd30daf0-da2a-4178-8d22-f48e7e273bb9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Jun 24 10:28:43.029372 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:43.094155 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-026f9e71-a57d-48b7-b6d2-c863ee0741f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:43.114521 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-026f9e71-a57d-48b7-b6d2-c863ee0741f2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077515 Jun 24 10:28:43.115295 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:43.127556 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-70b88d4a-48db-4d63-a999-53f461f185e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:43.151629 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-70b88d4a-48db-4d63-a999-53f461f185e8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027734 Jun 24 10:28:43.152207 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Jun 24 10:28:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:45.635622 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-026f9e71-a57d-48b7-b6d2-c863ee0741f2 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:45.636888 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-026f9e71-a57d-48b7-b6d2-c863ee0741f2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Jun 24 10:28:45.637566 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:45.700728 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-985a361e-7d0b-4ce5-87c1-65a9f43a277c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:45.719908 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-985a361e-7d0b-4ce5-87c1-65a9f43a277c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075152 Jun 24 10:28:45.720372 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:45.733055 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ccc4b60d-1563-4dbc-87e5-1f17734ce145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:45.758457 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-ccc4b60d-1563-4dbc-87e5-1f17734ce145 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029325 Jun 24 10:28:45.759089 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Jun 24 10:28:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:28:47.814274 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-985a361e-7d0b-4ce5-87c1-65a9f43a277c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:47.815285 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-985a361e-7d0b-4ce5-87c1-65a9f43a277c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 24 10:28:47.815921 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:47.876648 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-347c763a-6f81-4257-86cf-7fa1c016945d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "id": "4", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:47.896048 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-347c763a-6f81-4257-86cf-7fa1c016945d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074109 Jun 24 10:28:47.896605 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:28:47.908368 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-33b3c6cb-60ac-42e9-9fd2-5d1e5a20b644 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:47.933008 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-33b3c6cb-60ac-42e9-9fd2-5d1e5a20b644 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028236 Jun 24 10:28:47.933784 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Jun 24 10:28:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:28:49.979091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-347c763a-6f81-4257-86cf-7fa1c016945d admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:49.980171 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-347c763a-6f81-4257-86cf-7fa1c016945d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 24 10:28:49.980576 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:28:50.048104 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:50.069788 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082883 Jun 24 10:28:50.070809 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Jun 24 10:28:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:28:50.083097 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-3db34c34-2a7d-4fe5-ac44-006ddb5affed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:28:50.115638 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-3db34c34-2a7d-4fe5-ac44-006ddb5affed admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033057 Jun 24 10:28:50.115638 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Jun 24 10:28:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:29:14.454506 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:14.455522 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 24 10:29:14.456076 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:14.467507 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:29:14.515819 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-7c0e92a3-6a46-4c1e-befe-b12e49bde739 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:14.532612 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-7c0e92a3-6a46-4c1e-befe-b12e49bde739 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069769 Jun 24 10:29:14.533155 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Jun 24 10:29:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:15.477618 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.478616 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-607afe3f-ee9d-4e9d-a383-76a89402459a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 24 10:29:15.479003 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:15.678364 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b08466a8-472d-4143-8206-184f7c828725 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.684205 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-b08466a8-472d-4143-8206-184f7c828725 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b08466a8-472d-4143-8206-184f7c828725 admin admin] Request method failure captured: Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Host: 10.222.0.69 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABitZH7xJutXlGhI2KJ56AC4Aot5TjAOCxgrPq1k_dbDaJUks8oCRogZEo_H-erXag9xDgaqu92y1dY_FfQ2GVvdkphGb8-FnRdBQE1JjCO8arPu89xcSpuPIlc9gvMAAFsyqiPC5_5nv1vFeEWBvdIKyXZzLwsrMQKSDbjknlzRyFzkmk Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Role: member,admin,reader Jun 24 10:29:15.687544 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Roles: member,admin,reader Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User: admin Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: method: > Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: exception: Flavor 42 could not be found. Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: action_args: {'id': '42'} Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:15.689094 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:15.689996 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.691146 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b08466a8-472d-4143-8206-184f7c828725 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:15.692142 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b08466a8-472d-4143-8206-184f7c828725 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073949 Jun 24 10:29:15.692142 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:29:15.699213 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a78a531d-7378-46e3-803b-91674b07e7b4 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.702115 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:29:15.721539 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a78a531d-7378-46e3-803b-91674b07e7b4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025876 Jun 24 10:29:15.722092 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:15.732120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-cd585481-feda-4d35-bc32-8d17d30d4064 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.754366 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-cd585481-feda-4d35-bc32-8d17d30d4064 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025784 Jun 24 10:29:15.754893 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:29:15.764435 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f040f023-b9b4-46e4-8c41-27c84d7cd536 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.771265 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-f040f023-b9b4-46e4-8c41-27c84d7cd536 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f040f023-b9b4-46e4-8c41-27c84d7cd536 admin admin] Request method failure captured: Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept: application/json Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Host: 10.222.0.69 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABitZH7xJutXlGhI2KJ56AC4Aot5TjAOCxgrPq1k_dbDaJUks8oCRogZEo_H-erXag9xDgaqu92y1dY_FfQ2GVvdkphGb8-FnRdBQE1JjCO8arPu89xcSpuPIlc9gvMAAFsyqiPC5_5nv1vFeEWBvdIKyXZzLwsrMQKSDbjknlzRyFzkmk Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Role: member,admin,reader Jun 24 10:29:15.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Roles: member,admin,reader Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User: admin Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: method: > Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: exception: Flavor 42 could not be found. Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: action_args: {'id': '42'} Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:15.775937 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:15.776764 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:15.778045 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f040f023-b9b4-46e4-8c41-27c84d7cd536 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:15.779295 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f040f023-b9b4-46e4-8c41-27c84d7cd536 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015232 Jun 24 10:29:15.779295 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:29:16.591653 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-cd585481-feda-4d35-bc32-8d17d30d4064 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.592916 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-cd585481-feda-4d35-bc32-8d17d30d4064 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jun 24 10:29:16.593338 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:16.801349 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-2bedb155-37c4-4608-a029-731d45e593a8 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.807312 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-2bedb155-37c4-4608-a029-731d45e593a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-2bedb155-37c4-4608-a029-731d45e593a8 admin admin] Request method failure captured: Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept: application/json Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Host: 10.222.0.69 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABitZH8cgiPP5g_-XiMWS1e6WIBNeGEmgLCXZVNo2WfbYev3-zWVa3gLSSBrte0-9hCiaIzXd11DRIu0wYmuNHtHSObfkGqw-atAU4XD0vk5N6Qm0kRlqqZpDtMijiHSivUXEP8FsbTFF_M6VVQzjwTqNW3g8R8xBQkKDyevtNHEFfSldc Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Role: member,admin,reader Jun 24 10:29:16.808850 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Roles: member,admin,reader Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User: admin Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: method: > Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: exception: Flavor 84 could not be found. Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: action_args: {'id': '84'} Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:16.810225 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:16.811022 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.812028 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-2bedb155-37c4-4608-a029-731d45e593a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:16.813086 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-2bedb155-37c4-4608-a029-731d45e593a8 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075942 Jun 24 10:29:16.813086 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:29:16.820042 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-1b82b354-39c9-4902-bdeb-3502dfa054ae admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.833858 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-1b82b354-39c9-4902-bdeb-3502dfa054ae admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017426 Jun 24 10:29:16.834384 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:16.844235 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-071efc8c-581d-4de0-a0a7-f597713aa2d4 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.861321 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-071efc8c-581d-4de0-a0a7-f597713aa2d4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020570 Jun 24 10:29:16.861831 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:16.874520 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ad70a58d-ec65-49f9-9abe-55125d150281 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.880161 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-ad70a58d-ec65-49f9-9abe-55125d150281 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ad70a58d-ec65-49f9-9abe-55125d150281 admin admin] Request method failure captured: Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Host: 10.222.0.69 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABitZH8cgiPP5g_-XiMWS1e6WIBNeGEmgLCXZVNo2WfbYev3-zWVa3gLSSBrte0-9hCiaIzXd11DRIu0wYmuNHtHSObfkGqw-atAU4XD0vk5N6Qm0kRlqqZpDtMijiHSivUXEP8FsbTFF_M6VVQzjwTqNW3g8R8xBQkKDyevtNHEFfSldc Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Role: member,admin,reader Jun 24 10:29:16.881715 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Roles: member,admin,reader Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User: admin Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: method: > Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: exception: Flavor 84 could not be found. Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: action_args: {'id': '84'} Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:16.883120 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:16.883927 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:16.885091 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ad70a58d-ec65-49f9-9abe-55125d150281 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:16.886061 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-ad70a58d-ec65-49f9-9abe-55125d150281 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012161 Jun 24 10:29:16.886061 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 10:29:17.697036 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-071efc8c-581d-4de0-a0a7-f597713aa2d4 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:17.698033 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-071efc8c-581d-4de0-a0a7-f597713aa2d4 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 24 10:29:17.698416 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:17.907505 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a7a84bfb-b311-4cec-a713-c91aa08099b2 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:17.914287 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-a7a84bfb-b311-4cec-a713-c91aa08099b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a7a84bfb-b311-4cec-a713-c91aa08099b2 admin admin] Request method failure captured: Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Host: 10.222.0.69 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABitZH9JUHqNuWLAdn-dPRgWWKT4AmdK0QBeAYUyF-iXvb7MFJCU5FtBuPx3GwyofORaEU6aRaSqMlaL4p9QgDy94_xI4an6KOq2rWvPsre4vhIDiwAv10t8ygxpUFJTQxK3Xjmn2YLjgvb_5enCLUJBjmYCuSh8jssHHhmapX-Xn6tj5A Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Role: member,admin,reader Jun 24 10:29:17.915778 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Roles: member,admin,reader Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User: admin Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: method: > Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: exception: Flavor 451 could not be found. Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: action_args: {'id': '451'} Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:17.917147 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:17.918060 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.919280 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a7a84bfb-b311-4cec-a713-c91aa08099b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:17.920604 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a7a84bfb-b311-4cec-a713-c91aa08099b2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.078306 Jun 24 10:29:17.920604 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:29:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:29:17.927146 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3a8c79cb-4d13-44bd-9cad-a48b9a30a242 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:17.941419 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3a8c79cb-4d13-44bd-9cad-a48b9a30a242 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017930 Jun 24 10:29:17.941955 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:17.951484 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:17.965983 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017988 Jun 24 10:29:17.966692 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Fri Jun 24 10:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:29:17.976121 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f9998171-b7b2-4bd5-8d7c-cb02e483f7b3 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:17.981748 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-f9998171-b7b2-4bd5-8d7c-cb02e483f7b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f9998171-b7b2-4bd5-8d7c-cb02e483f7b3 admin admin] Request method failure captured: Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept: application/json Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Host: 10.222.0.69 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABitZH9JUHqNuWLAdn-dPRgWWKT4AmdK0QBeAYUyF-iXvb7MFJCU5FtBuPx3GwyofORaEU6aRaSqMlaL4p9QgDy94_xI4an6KOq2rWvPsre4vhIDiwAv10t8ygxpUFJTQxK3Xjmn2YLjgvb_5enCLUJBjmYCuSh8jssHHhmapX-Xn6tj5A Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Role: member,admin,reader Jun 24 10:29:17.983251 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Roles: member,admin,reader Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0f9dd8794ad7494bbf369d7c8ce42c78", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0f9dd8794ad7494bbf369d7c8ce42c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 0f9dd8794ad7494bbf369d7c8ce42c78 Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User: admin Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Id: 86fea4d6526441fa9d310035bfcc8012 Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: method: > Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: exception: Flavor 451 could not be found. Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: action_args: {'id': '451'} Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:17.984714 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:17.985726 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jun 24 10:29:17.986945 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f9998171-b7b2-4bd5-8d7c-cb02e483f7b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:17.988458 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f9998171-b7b2-4bd5-8d7c-cb02e483f7b3 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012304 Jun 24 10:29:17.988458 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:29:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:29:18.842189 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:18.843816 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Jun 24 10:29:18.844392 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:19.052656 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a97cc53a-8dc9-4820-97fa-8e93410870f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:19.073148 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a97cc53a-8dc9-4820-97fa-8e93410870f0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083429 Jun 24 10:29:19.073688 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Fri Jun 24 10:29:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:29:19.894506 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:19.895533 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Jun 24 10:29:19.895933 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:20.118086 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-426fd291-20f4-43ce-9526-a0d625975755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:20.142512 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-426fd291-20f4-43ce-9526-a0d625975755 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.105343 Jun 24 10:29:20.143042 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Fri Jun 24 10:29:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:29:20.981351 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:20.982401 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 24 10:29:20.982802 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:21.184577 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-42e9e612-7872-4038-8d54-fbe3c51a283d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:21.206063 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-42e9e612-7872-4038-8d54-fbe3c51a283d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087496 Jun 24 10:29:21.206847 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Fri Jun 24 10:29:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:29:22.020300 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:22.021346 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 24 10:29:22.021745 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:22.222553 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f3adf843-5a5c-47e0-9b3e-a89915f5b3fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:22.241386 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f3adf843-5a5c-47e0-9b3e-a89915f5b3fe admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085946 Jun 24 10:29:22.241868 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Fri Jun 24 10:29:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:29:23.065903 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:23.066929 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Jun 24 10:29:23.067356 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:23.264060 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6118c0e7-4655-4480-9126-783a328598e6 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:23.283294 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6118c0e7-4655-4480-9126-783a328598e6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078224 Jun 24 10:29:23.283841 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Fri Jun 24 10:29:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:30:10.176149 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.177240 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5b25510c-c28e-4fa6-9e4e-d59826df7401 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 24 10:30:10.177646 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:30:10.188122 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:10.239834 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0396dc00-1660-46fe-a99f-f81a8ab283bd admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.259012 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-0396dc00-1660-46fe-a99f-f81a8ab283bd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075438 Jun 24 10:30:10.259544 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:30:10.282680 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-47d8b1ae-bb0a-4670-98a8-b4e73f2100d6 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.286746 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=14 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:10.292610 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-47d8b1ae-bb0a-4670-98a8-b4e73f2100d6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013727 Jun 24 10:30:10.293180 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:10.305634 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-32e4ba31-6bc6-4f5a-a1bb-1255c8d233ce admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.313600 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-32e4ba31-6bc6-4f5a-a1bb-1255c8d233ce admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011608 Jun 24 10:30:10.314190 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:10.326004 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.334810 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012466 Jun 24 10:30:10.335338 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:10.346972 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4ca76cc0-d02e-4195-ac13-1389880f2d6e admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:10.354602 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4ca76cc0-d02e-4195-ac13-1389880f2d6e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Jun 24 10:30:10.355121 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Fri Jun 24 10:30:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:33:26.393235 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:26.394246 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 24 10:33:26.394634 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:33:26.539925 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=6 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:26.656473 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:26.657668 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:33:26.657668 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:33:26.659145 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:26.659578 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:26.660364 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:26.660771 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:26.695123 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5814094e-e549-4ee2-9e45-6a42945f6657 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163253 Jun 24 10:33:26.695645 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:33:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:33:27.519373 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:27.520425 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 24 10:33:27.520852 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:33:27.735535 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:27.736890 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:33:27.736890 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:33:27.738186 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:27.738622 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:27.739420 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:27.739848 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:27.759438 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f99f49a5-5984-4330-a495-9635fe2ee9c5 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.097825 Jun 24 10:33:27.760001 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:33:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:33:39.023818 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:39.024868 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 24 10:33:39.025266 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:33:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:33:39.176123 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:39.176875 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:39.177482 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=8 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:39.230812 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:39.231949 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:33:39.231949 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:33:39.233171 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:39.233681 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:39.234451 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:39.234864 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:39.259301 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-9800d1e5-aa37-4eb4-bf2a-838b978769ba admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087628 Jun 24 10:33:39.259841 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:33:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:33:40.082030 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:40.083050 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-fab25dfd-9e5c-49a2-9bb8-00000da59351 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 24 10:33:40.083447 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Fri Jun 24 10:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:33:40.297016 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:33:40.298178 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:33:40.298178 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jun 24 10:33:40.299354 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:40.299788 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:40.300563 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:33:40.301018 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:33:40.322830 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-9353e062-674e-4aaa-883d-8731b5b87e0b admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.100621 Jun 24 10:33:40.323395 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Fri Jun 24 10:33:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:34:35.818320 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: Fri Jun 24 10:34:35 2022 - graceful shutdown triggered... Jun 24 10:34:35.818959 dv-cinder-847536-1-iscsi devstack@n-api.service[103340]: Gracefully killing worker 1 (pid: 103340)... Jun 24 10:34:35.819432 dv-cinder-847536-1-iscsi devstack@n-api.service[103341]: Gracefully killing worker 2 (pid: 103341)... Jun 24 10:34:35.819087 dv-cinder-847536-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 10:34:36.820279 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: worker 1 buried after 1 seconds Jun 24 10:34:36.820279 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: worker 2 buried after 1 seconds Jun 24 10:34:36.820279 dv-cinder-847536-1-iscsi devstack@n-api.service[103339]: goodbye to uWSGI. Jun 24 10:34:36.822701 dv-cinder-847536-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 10:34:36.823576 dv-cinder-847536-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 10:34:36.828106 dv-cinder-847536-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 10:34:36.843763 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:34:36 2022] *** Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: nodename: dv-cinder-847536-1-iscsi Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: machine: x86_64 Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: clock source: unix Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: pcre jit disabled Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: detected number of CPU cores: 4 Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: current working directory: / Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:34:36.847015 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: your processes number limit is 47680 Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: your memory page size is 4096 bytes Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: detected max file descriptor number: 2048 Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: lock engine: pthread robust mutexes Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: thunder lock: enabled Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 10:34:36.847707 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:34:36.893214 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: Python main interpreter initialized at 0x564d7cf019c0 Jun 24 10:34:36.893214 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: python threads support enabled Jun 24 10:34:36.893214 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: your server socket listen backlog is limited to 100 connections Jun 24 10:34:36.893214 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:34:36.893631 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:34:36.893725 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: *** Operational MODE: preforking *** Jun 24 10:34:36.894237 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:34:36.894392 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: spawned uWSGI master process (pid: 124286) Jun 24 10:34:36.894738 dv-cinder-847536-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 10:34:36.895497 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: spawned uWSGI worker 1 (pid: 124303, cores: 1) Jun 24 10:34:36.895979 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: spawned uWSGI worker 2 (pid: 124304, cores: 1) Jun 24 10:34:36.896258 dv-cinder-847536-1-iscsi devstack@n-api.service[124286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:34:37.553385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:34:37.553979 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:34:38.744290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:34:38.744290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: from cryptography.utils import int_from_bytes Jun 24 10:34:38.745036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:34:38.745036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: from cryptography.utils import int_from_bytes Jun 24 10:34:38.746085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:34:38.746085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: from cryptography.utils import int_from_bytes Jun 24 10:34:38.746516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:34:38.746516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: from cryptography.utils import int_from_bytes Jun 24 10:34:41.127229 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:34:41.128624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:34:41.128624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:34:41.129107 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:34:41.129107 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:34:41.129535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:34:41.129535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:34:41.129689 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:34:41.129775 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.129855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:34:41.129935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130005 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:34:41.130073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130155 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130226 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130520 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130776 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.130991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.131948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132237 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132540 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-1-iscsi {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132699 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.132905 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133779 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847536-1-iscsi {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.133921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.134861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.135011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.135011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.136655 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.136929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.137190 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.137439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.137644 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.137863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.138110 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.138316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.138535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.138746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.138958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.139169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.139384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.139599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.139803 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.140019 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.140226 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.140470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.140701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.140940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.141172 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.141388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.141592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-1-iscsi {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.141816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.142002 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.142422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.142585 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.142812 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847536-1-iscsi {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.143692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.143692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.143692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.143692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.144280 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.144440 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.144676 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.144865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.145042 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.145279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.145279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.145890 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146044 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146350 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146794 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.146794 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.147885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148788 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.148946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149747 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.149906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150189 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150353 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.150947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151095 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151252 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151546 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.151977 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.152151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.152330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.152710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.152891 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.153061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.153459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.153611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.153754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.153905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154659 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.154951 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.155102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.155254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.155396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.155565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.155947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156252 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156396 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156554 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.156902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.157057 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.157405 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.157567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.157712 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.157854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158313 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158923 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.158923 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.159282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.159438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.159592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.159592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.159885 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160797 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.160957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161265 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.161898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.162053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.162202 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.162343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.162485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.162846 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.163014 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.163167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.163558 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.163717 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.163861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.164966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.165122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.165284 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.165460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.165606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.165747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.166200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.166370 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.166661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.166810 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.166952 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167410 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167552 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.167988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168137 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168433 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168582 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.168947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169095 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169236 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169570 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.169888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170029 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170176 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170613 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170753 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.170903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.171963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.172112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.172254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.172394 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.172542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.172928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.173101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.173253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.173581 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.173804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.173961 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.174163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.174390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.174390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.174743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.174952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.175207 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.175353 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.175494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.175634 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.175784 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.176051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.176414 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.176587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.176770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.176967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177258 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177414 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177564 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177712 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.177854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178005 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178312 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.178606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178755 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.178896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.178896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.179264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.179264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.179546 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.179546 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.179824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.179976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.180125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.180275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.180427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.180576 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:34:41.180718 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.180718 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181172 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181321 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181502 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181810 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.181958 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182247 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.182873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.183250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.183399 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.183645 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.183962 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184278 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184759 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.184908 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185252 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185583 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185731 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.185880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.186049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.186302 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.186628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.186778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.186928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187531 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187822 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.187977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188127 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188563 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.188926 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.189135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.189289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.189447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.189601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.189782 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.190059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.190640 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.190806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.190959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.191236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.191412 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.191572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.191716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.191879 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192022 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192926 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.192926 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.193451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.193451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.193821 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194148 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194448 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.194895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195781 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.195922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.196075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.196247 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.196474 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.199500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.199800 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.199986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200149 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200612 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200776 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.200928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201120 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.201912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202212 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.202935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.203089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.203250 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.203646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.203815 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204640 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204798 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.204946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.205088 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.205246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.205421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.205684 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.206204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.206370 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.206624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.206784 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.206955 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.207310 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.207461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.207605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.207747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.207898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208057 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208202 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208359 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.208858 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209798 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.209958 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210717 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.210861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211525 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211831 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.211980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212440 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.212911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.213054 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.213195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.213346 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.214957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215299 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215453 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215755 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.215914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.216906 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.217069 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.217339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.217487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.217659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.217935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218232 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.218965 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.219957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220241 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220840 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.220983 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.221299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.221825 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.221825 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.222992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223141 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223750 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.223903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.224268 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.224436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.224436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.224914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.225937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226695 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.226839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.227068 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.227217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.227376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.227606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.227762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228002 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228158 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228596 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228760 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.228929 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.229135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.229297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.229449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.229720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.229964 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230408 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230561 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.230870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231012 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231162 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231811 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.231952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232381 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.232893 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233501 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.233993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.234160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.234508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.234815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.234974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235271 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235562 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.235854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236003 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.236788 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.237555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.237817 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.237995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238244 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238552 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238843 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.238985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239136 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239738 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.239898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.240120 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.240296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241495 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241805 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.241954 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242416 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242560 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242852 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.242993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243450 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243607 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.243911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.244067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.244312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.244688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245193 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.245974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.246129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.246277 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.246440 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.246604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.246884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.247053 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.247204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.247353 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.247535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.247767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248798 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.248955 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.249214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.249410 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.249576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.249739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.249739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250030 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250587 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250743 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.250899 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251557 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251715 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.251863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.252010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.252157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.252390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.253394 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.253562 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.254336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.254499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.254876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.255314 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.255314 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.255627 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.255788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.255945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.256094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.256094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.256376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.256710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.256909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.257072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.257230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.257497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.257680 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.257943 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.258222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.258503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.258669 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.258816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.258816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259049 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.259983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.260935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.261876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262013 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262469 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.262875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263260 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263434 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263578 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.263983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.264114 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.264251 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.264392 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.264520 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.264654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265013 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265148 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.265882 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266021 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266302 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.266946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.267763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.268089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.268945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269581 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.269898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270170 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270298 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.270923 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271062 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271467 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271732 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.271985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.272778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.273392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.273800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.273935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.274071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.274198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.274331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.274472 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.274889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.275213 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.275374 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.275647 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.275779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.275921 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276351 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276835 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.276976 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.277908 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278042 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.278913 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279124 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279393 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279749 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.279749 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280146 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280146 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280513 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.280907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.281056 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.281193 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.281328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.281684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.281684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282356 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.282976 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.283112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.283239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.283239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.283502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.284222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.284222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.285104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.285453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.285453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.285863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.286890 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287555 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.287940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288077 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.288986 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.289271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.289426 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.289570 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.289570 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.289931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290329 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290329 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290728 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.290870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291344 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.291874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292414 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292548 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292548 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.292942 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293592 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.293978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.294115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.294250 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.294922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.295074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.295205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.295610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.295918 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.295918 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296190 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.296868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297012 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297012 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.297892 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.298700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.299030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.299219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.299219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.299691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.300667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.300867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301589 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.301892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302465 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.302891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.303998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304141 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304291 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.304795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.305087 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.305230 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.305230 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.305769 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306353 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306495 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.306799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307484 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.307921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.308476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.308622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.308622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.308916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.309934 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.310085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.310085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.310377 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.310745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.310745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311557 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.311864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312299 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312299 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312587 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.312907 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313050 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313682 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313825 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.313973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.314116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.314116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.314404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.314547 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.314547 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.315034 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.315872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316651 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.316973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317550 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.317851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318152 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318449 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318769 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.318919 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319505 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319666 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.319950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320673 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320849 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.320994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321136 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321469 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.321988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322450 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.322893 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323042 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323506 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.323940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324251 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.324851 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.325738 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326857 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.326857 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.327925 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.328983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.329933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.330119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.330266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.330769 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.330941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.331096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.331240 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.331383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.331544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.331714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332024 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332344 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.332967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.333977 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334127 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334741 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.334885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335026 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335324 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335781 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.335924 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.336265 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.336566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.336717 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.336948 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337258 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.337930 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.338074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.338215 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.338357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.338840 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339002 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339457 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339744 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.339894 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340765 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.340914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341069 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341232 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341684 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.341834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342223 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342521 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.342934 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343391 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.343985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.344203 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.344359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.344511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.344660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.344888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345046 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345201 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345513 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.345838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.346011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.346931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.347371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348057 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348208 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348827 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.348984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349715 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.349876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.350895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.351896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352426 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.352711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.353949 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.354908 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.355145 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.355352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.355557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.355711 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.355879 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.356030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.356181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.356340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.356563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.356720 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357209 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357354 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357775 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.357945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358538 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358681 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.358981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359572 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359751 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.359908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360052 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360194 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360794 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.360952 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.361113 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.361259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.361259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.361545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.362426 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.362606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.362762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.362916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363201 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363351 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.363947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364091 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364239 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364475 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364844 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.364996 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365139 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365280 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.365720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.366009 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.366160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.366302 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.366671 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.366824 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367059 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367219 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367672 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367815 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.367958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368792 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.368941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.369970 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370121 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370578 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370728 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.370870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371012 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.371902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372195 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372337 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.372948 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373100 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373385 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373527 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373823 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.373967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374786 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.374930 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375679 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375820 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.375969 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.376983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.377203 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.377458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378375 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378681 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.378842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379152 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379295 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379579 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.379880 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380455 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380612 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380612 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.380956 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381553 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.381980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382573 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382735 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.382967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383271 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383416 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.383985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.384969 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385561 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385711 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.385873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386016 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386740 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.386973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387805 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.387950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.388884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389368 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389667 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.389959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390563 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.390866 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391024 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391175 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391481 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391765 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.391914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.392948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393325 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393647 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393805 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.393963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394035 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394242 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394312 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394466 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394750 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394831 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.394985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395261 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395484 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.395998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396076 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396232 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396373 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396585 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.396938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.397628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.398917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.399510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.400683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.401909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.402146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.402442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.402789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.403114 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.403461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.403777 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.404121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.404449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.404763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.405110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.405412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:34:41.405611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:34:41.444057 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO dbcounter [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Registered counter for database nova_api Jun 24 10:34:41.465318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_db.sqlalchemy.engines [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.468316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO dbcounter [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Registered counter for database nova_api Jun 24 10:34:41.473074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writer thread running {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.488572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_db.sqlalchemy.engines [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.495458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writer thread running {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.530897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.context [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5c325af-f7fa-481f-b3fd-d4961ecadde3(cell1) {{(pid=124304) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:34:41.535628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:34:41.537264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:34:41.538072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:34:41.540051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:34:41.542095 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO dbcounter [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Registered counter for database nova_cell0 Jun 24 10:34:41.546124 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO dbcounter [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Registered counter for database nova_cell1 Jun 24 10:34:41.551097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.context [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5c325af-f7fa-481f-b3fd-d4961ecadde3(cell1) {{(pid=124303) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:34:41.554517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_db.sqlalchemy.engines [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.555100 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_db.sqlalchemy.engines [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.555393 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:34:41.557040 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:34:41.557855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:34:41.559833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:34:41.561382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writer thread running {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.561870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO dbcounter [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Registered counter for database nova_cell0 Jun 24 10:34:41.565961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO dbcounter [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Registered counter for database nova_cell1 Jun 24 10:34:41.573211 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_db.sqlalchemy.engines [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.575868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_db.sqlalchemy.engines [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.579693 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writer thread running {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.707362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writer thread running {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.720170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writer thread running {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.722159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO dbcounter [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Registered counter for database nova_cell0 Jun 24 10:34:41.730994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_db.sqlalchemy.engines [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.732539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO dbcounter [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Registered counter for database nova_cell0 Jun 24 10:34:41.736527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writer thread running {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:41.741601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_db.sqlalchemy.engines [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:34:41.746086 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writer thread running {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:34:42.059345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: WARNING keystonemiddleware.auth_token [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:34:42.063551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: WARNING keystonemiddleware.auth_token [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:34:42.066994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: WARNING keystonemiddleware.auth_token [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:34:42.071703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: WARNING keystonemiddleware.auth_token [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:34:42.412584 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: WARNING keystonemiddleware.auth_token [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:34:42.418698 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: WARNING keystonemiddleware.auth_token [None req-4433352f-15dd-4c55-8c02-ab80186dd457 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:34:42.424187 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d7cf019c0 pid: 124303 (default app) Jun 24 10:34:42.430881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: WARNING keystonemiddleware.auth_token [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:34:42.437007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: WARNING keystonemiddleware.auth_token [None req-474f3399-56fd-4768-9acc-7dc2eadee044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:34:42.442530 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d7cf019c0 pid: 124304 (default app) Jun 24 10:35:22.142743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.144270 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.145540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.146450 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.293698 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.294689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.296305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:22.300484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:23.989678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a7dc5f51-db39-4786-b0f1-7f636b438965 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Action: 'create', calling method: .version_select at 0x7f1764910790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-105252589", "metadata": {"Type": "work"}}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:24.207339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f7fec115-1e79-443a-b37c-57ac371aa21e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Action: 'create', calling method: .version_select at 0x7f1764916700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1919499868"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:26.369808 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a7dc5f51-db39-4786-b0f1-7f636b438965 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.093847 Jun 24 10:35:26.371323 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1155 bytes} [Fri Jun 24 10:35:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4098 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 10:35:26.385821 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7024671f-eb37-4a13-8209-68b0d0e766d7 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647db5e0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:26.402527 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f7fec115-1e79-443a-b37c-57ac371aa21e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.274563 Jun 24 10:35:26.404936 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 1/2] 10.222.0.69 () {60 vars in 1154 bytes} [Fri Jun 24 10:35:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4279 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 10:35:26.419241 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9a11cad2-c9d2-43cf-8e61-d922c94b32ce tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647dc550>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:26.541650 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7024671f-eb37-4a13-8209-68b0d0e766d7 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 200 len: 352 microversion: 2.1 time: 0.162344 Jun 24 10:35:26.542841 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:26 2022] GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:26.608670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9a11cad2-c9d2-43cf-8e61-d922c94b32ce tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 200 len: 345 microversion: 2.1 time: 0.193927 Jun 24 10:35:26.609349 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:26 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:27.556418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3f22b6b3-9672-4163-99da-95c68d644870 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647db700>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:27.622853 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e4517d97-b2aa-45f8-9b42-3e41d662ad35 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647dc8b0>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:27.658897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3f22b6b3-9672-4163-99da-95c68d644870 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 200 len: 353 microversion: 2.1 time: 0.107221 Jun 24 10:35:27.660599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 3/5] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:27 2022] GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:27.672183 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2c63ac9d-8dee-40c9-9de5-6186d1e97c43 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647dbd30>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:27.796431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e4517d97-b2aa-45f8-9b42-3e41d662ad35 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 200 len: 346 microversion: 2.1 time: 0.178432 Jun 24 10:35:27.797261 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 3/6] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:27 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:35:27.810021 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2c63ac9d-8dee-40c9-9de5-6186d1e97c43 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 200 len: 353 microversion: 2.1 time: 0.142130 Jun 24 10:35:27.812477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:27 2022] GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:27.813606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-76c7f0d7-fff1-4053-91ce-05eda8135393 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Action: 'create', calling method: .version_select at 0x7f17647dcc10>, body: {"snapshot": {"volume_id": "3c3093db-4aa4-433b-a904-4f406a2f7e42", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-86784222"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:27.832049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ef8234bb-55bd-415d-8af2-7545763d87c2 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647ef430>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:28.255224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ef8234bb-55bd-415d-8af2-7545763d87c2 tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 202 len: 0 microversion: 2.1 time: 0.426333 Jun 24 10:35:28.256066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 5/8] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:35:27 2022] DELETE /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:35:28.264170 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7d4824bd-3029-4402-83cf-f0535f4304ee tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647dbd30>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:28.449747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7d4824bd-3029-4402-83cf-f0535f4304ee tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 200 len: 352 microversion: 2.1 time: 0.187722 Jun 24 10:35:28.450786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 6/9] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:28 2022] GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:28.654638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-76c7f0d7-fff1-4053-91ce-05eda8135393 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.819420 Jun 24 10:35:28.654638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 4/10] 10.222.0.69 () {60 vars in 1161 bytes} [Fri Jun 24 10:35:27 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:28.655219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-26523250-a297-4518-8281-6316b78e2294 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647db700>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:28.739913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-26523250-a297-4518-8281-6316b78e2294 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 285 microversion: 2.1 time: 0.106816 Jun 24 10:35:28.740482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 7/11] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:28 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:28.750287 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-fb797bc3-10df-4150-a37a-e5ee27e2f553 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647f3820>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:28.822897 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-fb797bc3-10df-4150-a37a-e5ee27e2f553 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.075668 Jun 24 10:35:28.823654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 5/12] 10.222.0.69 () {58 vars in 1139 bytes} [Fri Jun 24 10:35:28 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:28.837802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e02c4fdb-4079-41e9-84c9-7c0c745441be tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647ef5e0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:28.882758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e02c4fdb-4079-41e9-84c9-7c0c745441be tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 285 microversion: 2.1 time: 0.050735 Jun 24 10:35:28.883909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 8/13] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:28 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 285 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:29.463364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5485b98-5376-4307-80d9-a904495ab28a tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Calling method '.version_select at 0x7f17647f3790>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:29.509008 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-d5485b98-5376-4307-80d9-a904495ab28a tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] HTTP exception thrown: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5485b98-5376-4307-80d9-a904495ab28a tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Request method failure captured: Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 HTTP/1.1 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZNqTSpki5Gi9p8OFZa0Q_JUIjTKFLupVlecmm7iGZgjZbGPFfyjB5kBi9FdzLrVQR4KbeU-EzpD0is6QCkN44BVM5NM_IJj17k_RtD5iIpJg-vejPW0s-axtBd4tKyeditWgSDdwRaeEmlFKsDxkOOr4QoJ3fMAK1BExx4pZ_PSUJU Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 8539804dc27f42fe88833acb7b6cfa87 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesGetTestJSON-1362053656 Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:35:29.515594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8539804dc27f42fe88833acb7b6cfa87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8539804dc27f42fe88833acb7b6cfa87", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8539804dc27f42fe88833acb7b6cfa87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8539804dc27f42fe88833acb7b6cfa87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesGetTestJSON-1362053656 Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 8539804dc27f42fe88833acb7b6cfa87 Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesGetTestJSON-1362053656 Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesGetTestJSON-1362053656-project Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 9bb081bd64964cabb5986eb7cb976617 Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesGetTestJSON-1362053656-project Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'aa469c55-768c-4803-ba05-89c0c0618160'} Jun 24 10:35:29.516569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. (HTTP 404) (Request-ID: req-8fc3854f-3466-4500-8291-e82918a5da06) Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:29.517183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:29.518100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:35:29.519757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. Jun 24 10:35:29.520566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:29.521972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5485b98-5376-4307-80d9-a904495ab28a tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] Returning 404 to user: Volume aa469c55-768c-4803-ba05-89c0c0618160 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:35:29.523138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d5485b98-5376-4307-80d9-a904495ab28a tempest-VolumesGetTestJSON-1362053656 tempest-VolumesGetTestJSON-1362053656-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160" status: 404 len: 109 microversion: 2.1 time: 0.063659 Jun 24 10:35:29.523834 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 6/14] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:29 2022] GET /compute/v2.1/os-volumes/aa469c55-768c-4803-ba05-89c0c0618160 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:29.894998 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3d972569-667f-41fa-8c72-ee7249e2956c tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647db700>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:29.978967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3d972569-667f-41fa-8c72-ee7249e2956c tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 285 microversion: 2.1 time: 0.087732 Jun 24 10:35:29.980568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 9/15] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:29 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:30.992051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ce821c14-5cd3-493a-ae64-569c0ca1ebcd tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647f3d30>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:31.056523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ce821c14-5cd3-493a-ae64-569c0ca1ebcd tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 285 microversion: 2.1 time: 0.068095 Jun 24 10:35:31.056523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 7/16] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:30 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 285 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:32.070001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a350a2c8-e866-42fa-b32f-941e147a1915 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647dbd30>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:32.155128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a350a2c8-e866-42fa-b32f-941e147a1915 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 286 microversion: 2.1 time: 0.089004 Jun 24 10:35:32.156254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 10/17] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:32 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:32.167279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4d847b20-d04c-4cb1-babc-9972c981e8bb tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647dca60>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:32.404564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4d847b20-d04c-4cb1-babc-9972c981e8bb tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 202 len: 0 microversion: 2.1 time: 0.240819 Jun 24 10:35:32.405428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 8/18] 10.222.0.69 () {58 vars in 1253 bytes} [Fri Jun 24 10:35:32 2022] DELETE /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:35:32.430498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4a3312b9-78e7-432d-b8d3-fbd246a69b60 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647ef1f0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:32.490674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4a3312b9-78e7-432d-b8d3-fbd246a69b60 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 200 len: 285 microversion: 2.1 time: 0.080326 Jun 24 10:35:32.491325 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 11/19] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:32 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:33.502768 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-15a6a8b7-7faf-4f67-a12a-f52ff84ede18 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647ef8b0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:33.568144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-15a6a8b7-7faf-4f67-a12a-f52ff84ede18 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] HTTP exception thrown: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-15a6a8b7-7faf-4f67-a12a-f52ff84ede18 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Request method failure captured: Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 HTTP/1.1 Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZNqhaUkM9k9pPvsn-vZBZgT71TIbYLWhhmb8vybh5IrpxkFfsfHb4oAhEWpTH-eQSRNUwxppEo-hU0uyDrRFRp5o3Ux0gedDKo6QIhlcnFXzRarzZMLF9H6uV3Pn0navDW4rcTr0fMZ5auFUUK3KdKheOJPegBAaETFdSZKiSnhBGM Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:35:33.573186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_98f3e7ee3a4648fcb630682d1ab59dba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: b1a6ca70bb944325a9e9424853a0bc48 Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '5183b756-b33a-4b23-982a-e2993231cca7'} Jun 24 10:35:33.574331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. (HTTP 404) (Request-ID: req-8835ab24-0424-4106-ae42-a00ff0b3370b) Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.575111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:33.576157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 10:35:33.577341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. Jun 24 10:35:33.578442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:33.581540 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-15a6a8b7-7faf-4f67-a12a-f52ff84ede18 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Returning 404 to user: Snapshot 5183b756-b33a-4b23-982a-e2993231cca7 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:35:33.582632 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-15a6a8b7-7faf-4f67-a12a-f52ff84ede18 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7" status: 404 len: 111 microversion: 2.1 time: 0.084013 Jun 24 10:35:33.583738 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 12/20] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:35:33 2022] GET /compute/v2.1/os-snapshots/5183b756-b33a-4b23-982a-e2993231cca7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:33.601766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c5777bb1-5351-48c6-8ebb-8356072cf03a tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647ef0d0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:33.763037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c5777bb1-5351-48c6-8ebb-8356072cf03a tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 202 len: 0 microversion: 2.1 time: 0.174574 Jun 24 10:35:33.764908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 13/21] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:35:33 2022] DELETE /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:35:33.772389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-edfc7ef6-e1f4-4fd7-b8c7-3bb337ce4af0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647ef1f0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:33.910786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-edfc7ef6-e1f4-4fd7-b8c7-3bb337ce4af0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 200 len: 345 microversion: 2.1 time: 0.142181 Jun 24 10:35:33.915902 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 14/22] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:33 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:34.270177 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2128864029", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "networks": [{"uuid": "752e9800-1649-43f8-947f-53990781f692"}]}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:34.372072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-68a65b7c-d635-4593-ad9c-0559307db9ef tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: .version_select at 0x7f176513fb80>, body: {"keypair": {"name": "tempest-keypair-607141775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQDcDdY7yt3SGFmYNfUm7cuHDPf749RaAvv+vugcZytyzH6oYNB1TLOS2Lsb1sp3iKO0RYjFdm6juyJw+79axmoIoPAJqSHel7L4QFSNpOXH7g7hh5AI28qHjZZDLP/jw=="}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:34.531514 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-68a65b7c-d635-4593-ad9c-0559307db9ef tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for project e41afc594f464d74bd4881e07dd33e45. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:34.548264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] validate_networks() for [('752e9800-1649-43f8-947f-53990781f692', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:35:34.566754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-68a65b7c-d635-4593-ad9c-0559307db9ef tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for user 733b7d5058da45089a2133e2fe4695e7 and project e41afc594f464d74bd4881e07dd33e45. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:34.721196 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-68a65b7c-d635-4593-ad9c-0559307db9ef tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.634921 Jun 24 10:35:34.722722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 15/23] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:35:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:35:34.925597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-83e2638c-f039-42ae-9678-4f1be07879f2 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f176472ad30>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:35.055800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-83e2638c-f039-42ae-9678-4f1be07879f2 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 200 len: 345 microversion: 2.1 time: 0.136040 Jun 24 10:35:35.056603 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 16/24] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:34 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:36.070139 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f125d8d4-befd-415b-acbe-fddbe05ccf1c tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17646de430>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:36.235178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f125d8d4-befd-415b-acbe-fddbe05ccf1c tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 200 len: 345 microversion: 2.1 time: 0.168997 Jun 24 10:35:36.241161 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 17/25] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:36 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:35:36.421601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:35:36.422616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:35:36.423401 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:35:36.425320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:35:36.425953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:35:36.487725 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:36.489385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:36.494549 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:36.496700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:36.577668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Getting quotas for project dee3d0adc7084828b9ed954edee54f6a. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:36.598365 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Getting quotas for user 16daeab4accb4eeca4100b55dc9bcaa2 and project dee3d0adc7084828b9ed954edee54f6a. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:36.636749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:35:36.639920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:35:36.784286 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f58df44f-a7e8-4889-b2f2-166cc0d9bec8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.377739 Jun 24 10:35:36.786115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 9/26] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:35:36.795630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-95aa421a-7e41-4315-849a-9022415357c5 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:36.796390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-95aa421a-7e41-4315-849a-9022415357c5 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:37.249079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87f5fe03-5a10-4299-8d71-f7c5d27ea5c0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f1763e62280>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:37.320073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-87f5fe03-5a10-4299-8d71-f7c5d27ea5c0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] HTTP exception thrown: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87f5fe03-5a10-4299-8d71-f7c5d27ea5c0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Request method failure captured: Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 HTTP/1.1 Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZNqhaUkM9k9pPvsn-vZBZgT71TIbYLWhhmb8vybh5IrpxkFfsfHb4oAhEWpTH-eQSRNUwxppEo-hU0uyDrRFRp5o3Ux0gedDKo6QIhlcnFXzRarzZMLF9H6uV3Pn0navDW4rcTr0fMZ5auFUUK3KdKheOJPegBAaETFdSZKiSnhBGM Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:35:37.322462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_98f3e7ee3a4648fcb630682d1ab59dba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: b1a6ca70bb944325a9e9424853a0bc48 Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '3c3093db-4aa4-433b-a904-4f406a2f7e42'} Jun 24 10:35:37.323832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. (HTTP 404) (Request-ID: req-4f897221-ce1e-4ac1-a31b-97b9b9300912) Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.324564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:37.325577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:35:37.326598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87f5fe03-5a10-4299-8d71-f7c5d27ea5c0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Returning 404 to user: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:35:37.327508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-87f5fe03-5a10-4299-8d71-f7c5d27ea5c0 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 404 len: 109 microversion: 2.1 time: 0.079718 Jun 24 10:35:37.328814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 10/27] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:37 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:37.350024 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af8db0f3-e779-4ed0-821a-cfc098ca5f5e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f17647f3700>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:37.398605 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-95aa421a-7e41-4315-849a-9022415357c5 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:37.474562 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-95aa421a-7e41-4315-849a-9022415357c5 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1215 microversion: 2.1 time: 0.682983 Jun 24 10:35:37.479954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 18/28] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:36 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1215 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:37.510300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-af8db0f3-e779-4ed0-821a-cfc098ca5f5e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] HTTP exception thrown: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af8db0f3-e779-4ed0-821a-cfc098ca5f5e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Request method failure captured: Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 HTTP/1.1 Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZNqhaUkM9k9pPvsn-vZBZgT71TIbYLWhhmb8vybh5IrpxkFfsfHb4oAhEWpTH-eQSRNUwxppEo-hU0uyDrRFRp5o3Ux0gedDKo6QIhlcnFXzRarzZMLF9H6uV3Pn0navDW4rcTr0fMZ5auFUUK3KdKheOJPegBAaETFdSZKiSnhBGM Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:35:37.521347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_98f3e7ee3a4648fcb630682d1ab59dba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: b1a6ca70bb944325a9e9424853a0bc48 Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '3c3093db-4aa4-433b-a904-4f406a2f7e42'} Jun 24 10:35:37.522570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. (HTTP 404) (Request-ID: req-b707356f-1c93-48ce-9bd2-2dba52ccf3cc) Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.523903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:35:37.525498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:35:37.526598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.527705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.530002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af8db0f3-e779-4ed0-821a-cfc098ca5f5e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Returning 404 to user: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:35:37.531170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-af8db0f3-e779-4ed0-821a-cfc098ca5f5e tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 404 len: 109 microversion: 2.1 time: 0.201369 Jun 24 10:35:37.532361 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 11/29] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:35:37 2022] DELETE /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:37.541834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5a9fa216-5ec7-42ff-a21c-d2f3e379a623 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Calling method '.version_select at 0x7f176472a8b0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:37.640783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-5a9fa216-5ec7-42ff-a21c-d2f3e379a623 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] HTTP exception thrown: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5a9fa216-5ec7-42ff-a21c-d2f3e379a623 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Request method failure captured: Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 HTTP/1.1 Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZNqhaUkM9k9pPvsn-vZBZgT71TIbYLWhhmb8vybh5IrpxkFfsfHb4oAhEWpTH-eQSRNUwxppEo-hU0uyDrRFRp5o3Ux0gedDKo6QIhlcnFXzRarzZMLF9H6uV3Pn0navDW4rcTr0fMZ5auFUUK3KdKheOJPegBAaETFdSZKiSnhBGM Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:35:37.643703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_98f3e7ee3a4648fcb630682d1ab59dba", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/98f3e7ee3a4648fcb630682d1ab59dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 98f3e7ee3a4648fcb630682d1ab59dba Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-438956821 Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: b1a6ca70bb944325a9e9424853a0bc48 Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-438956821-project Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '3c3093db-4aa4-433b-a904-4f406a2f7e42'} Jun 24 10:35:37.644690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. (HTTP 404) (Request-ID: req-12c8bd59-6e19-422f-b49c-28ed73013544) Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.645336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:35:37.646184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:35:37.647046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5a9fa216-5ec7-42ff-a21c-d2f3e379a623 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] Returning 404 to user: Volume 3c3093db-4aa4-433b-a904-4f406a2f7e42 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5a9fa216-5ec7-42ff-a21c-d2f3e379a623 tempest-VolumesSnapshotsTestJSON-438956821 tempest-VolumesSnapshotsTestJSON-438956821-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42" status: 404 len: 109 microversion: 2.1 time: 0.108348 Jun 24 10:35:37.647871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 19/30] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:37 2022] GET /compute/v2.1/os-volumes/3c3093db-4aa4-433b-a904-4f406a2f7e42 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:38.508903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c1c5df4d-7e31-424c-8e3f-8a7477450ab4 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:38.510111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c1c5df4d-7e31-424c-8e3f-8a7477450ab4 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:38.680227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c1c5df4d-7e31-424c-8e3f-8a7477450ab4 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:38.710142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c1c5df4d-7e31-424c-8e3f-8a7477450ab4 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1215 microversion: 2.1 time: 0.204792 Jun 24 10:35:38.714862 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 12/31] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:38 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:39.730198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:39.739619 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:39.799516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:39.800301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:39.816290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:39.820364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:40.412455 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:40.448122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-40b02208-2453-4d21-a761-1630a8d441f2 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1267 microversion: 2.1 time: 0.724185 Jun 24 10:35:40.449156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 20/32] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:39 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1267 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:41.466187 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:41.467420 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:41.475169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:41.475804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:41.476758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:41.477334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:41.691463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:41.706380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-353cf2fa-f528-4116-9dcc-d7f6d932d57f tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1275 microversion: 2.1 time: 0.244129 Jun 24 10:35:41.707367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 13/33] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:41 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:42.731137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:42.732376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:42.750054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:42.753462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:42.754309 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:42.754845 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:43.183301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:43.197399 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-620d8cb9-f300-41e5-a77e-afaff633a2f8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1275 microversion: 2.1 time: 0.468559 Jun 24 10:35:43.199199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 21/34] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:42 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1275 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:43.483967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1872790451", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45f93fe-c90f-4708-aa2a-5a1fde71bcad"}], "security_groups": [{"name": "tempest-securitygroup--1422564219"}], "key_name": "tempest-keypair-607141775", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:43.779807 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-aaaf6c47-9319-4434-90da-2f015264ff75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: .version_select at 0x7f1763589af0>, body: {"keypair": {"name": "tempest-keypair-1146620408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcaOyu9ql2XXuYXeC5XxB6PGspDuQ2qCmhutM/41fyqZwoIAwWXwoIA5nuEQafmBsl/OmlgTNe09FlILnuk7BqeA6mSh1lC5hfIuPTeHSvEB8+fj/EBrmhZrSRf3Rn6qg=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:43.816717 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-aaaf6c47-9319-4434-90da-2f015264ff75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for project 281651371cba4d4a9454b0747947cc83. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:43.851434 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-aaaf6c47-9319-4434-90da-2f015264ff75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for user 3e4ed08c1c81453abaa6c1dd826f0258 and project 281651371cba4d4a9454b0747947cc83. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:43.965096 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-aaaf6c47-9319-4434-90da-2f015264ff75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.947800 Jun 24 10:35:43.976986 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 14/35] 10.222.0.69 () {62 vars in 1199 bytes} [Fri Jun 24 10:35:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 960 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 10:35:44.448381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] validate_networks() for [('d45f93fe-c90f-4708-aa2a-5a1fde71bcad', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:35:44.693073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-612394978", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:44.835462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] validate_networks() for [('45ee52c2-5913-4161-9d2c-193dab823ea6', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:35:46.539898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:47.448088 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:49.531247 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:35:49.531845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:35:49.532130 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:35:49.532539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:35:49.533590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:35:49.547494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:49.547938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:49.554585 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:49.555348 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:49.620590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:49.635055 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for user 960b18fe180f4185b291da1d9c18a2fa and project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:49.689255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:35:49.707279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:35:49.875707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-67e8bec3-3c1d-4959-b15d-6fe3d2c5a52b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.896454 Jun 24 10:35:49.876325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 15/36] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:35:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 5898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:35:49.890418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:49.891047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:49.917600 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:49.918052 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:49.928266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:49.928746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:50.920854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:35:50.921409 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:35:50.921795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:35:50.922209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:35:50.922617 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:35:50.952555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:50.953083 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:50.953894 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:50.954259 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:51.058199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:51.072088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-421ecf5d-77c8-4d1f-98e4-e8a9dbf94877 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 1.188183 Jun 24 10:35:51.072683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 16/37] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:49 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:51.093967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5889240-7e36-40f1-b4d9-c44254e78b64 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1763564a60>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:51.141041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for project e41afc594f464d74bd4881e07dd33e45. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:51.159795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for user 733b7d5058da45089a2133e2fe4695e7 and project e41afc594f464d74bd4881e07dd33e45. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:51.221836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:35:51.259227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:35:51.275506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d5889240-7e36-40f1-b4d9-c44254e78b64 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/d02f003b-6dee-4806-98aa-288cdd18d219" status: 200 len: 351 microversion: 2.1 time: 0.196410 Jun 24 10:35:51.276668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 17/38] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:51 2022] GET /compute/v2.1/os-volumes/d02f003b-6dee-4806-98aa-288cdd18d219 => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:51.282220 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-544da714-260c-4896-ba30-d3965be030a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:51.296726 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-544da714-260c-4896-ba30-d3965be030a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:51.456538 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-544da714-260c-4896-ba30-d3965be030a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:51.472883 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-544da714-260c-4896-ba30-d3965be030a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1221 microversion: 2.1 time: 0.187758 Jun 24 10:35:51.494660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 18/39] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:51 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1221 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:51.601532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-81749c8c-71a2-4473-83e4-42eedfcb3f19 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.129154 Jun 24 10:35:51.607140 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 22/40] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:35:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 8131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:35:51.613817 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8de03823-4043-4919-b909-6cbe51d6836a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:51.614521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8de03823-4043-4919-b909-6cbe51d6836a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:51.977672 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8de03823-4043-4919-b909-6cbe51d6836a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:52.000960 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8de03823-4043-4919-b909-6cbe51d6836a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1237 microversion: 2.1 time: 0.392006 Jun 24 10:35:52.009836 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 19/41] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:51 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1237 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:52.100913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:52.101529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:52.113889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:52.114337 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:52.127108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:52.127352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:52.151103 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-617856425", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:52.336460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] validate_networks() for [('45ee52c2-5913-4161-9d2c-193dab823ea6', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:35:53.814364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:53.828675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-162b463c-b13d-4781-b9eb-7137ce279d53 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 1.737679 Jun 24 10:35:53.829941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 23/42] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:52 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:53.839082 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-851378963", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c54d8b2-277b-49d0-99b7-bf6f64432c4a"}], "security_groups": [{"name": "tempest-securitygroup--1873710477"}], "key_name": "tempest-keypair-1146620408", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:54.349025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] validate_networks() for [('5c54d8b2-277b-49d0-99b7-bf6f64432c4a', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:35:54.693636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:35:54.694706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:35:54.695322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:35:54.695881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:35:54.696605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:35:54.722792 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:54.733313 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:54.734479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:54.735296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:54.807712 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:54.815984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for user 960b18fe180f4185b291da1d9c18a2fa and project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:54.851950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:35:54.858878 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:35:54.994575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2eab9030-ed6a-482c-9b32-ec6465a8ca6d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.845534 Jun 24 10:35:55.000288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 20/43] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:35:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:35:55.021228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:55.024705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:55.080582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:55.082171 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:55.083016 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:55.083446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:55.363392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:55.373878 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f554399a-7383-4fb7-950b-d86970ccd5c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1289 microversion: 2.1 time: 0.369707 Jun 24 10:35:55.383284 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 21/44] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:55 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1289 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:55.418120 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-00d096dc-fd54-438b-8342-1e6df62fb6b2 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f17635648b0>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:55.719463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-00d096dc-fd54-438b-8342-1e6df62fb6b2 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/16f6fe7d-f2b1-43ba-8a3c-67bb1a1b9f7b" status: 200 len: 351 microversion: 2.1 time: 0.332387 Jun 24 10:35:55.720628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 22/45] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:55 2022] GET /compute/v2.1/os-volumes/16f6fe7d-f2b1-43ba-8a3c-67bb1a1b9f7b => generated 351 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:55.727645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:55.728505 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:55.782447 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:55.786502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:55.805779 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:55.812399 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:56.800886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:35:56.801447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:35:56.801980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:35:56.802400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:35:56.802815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:35:56.846568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:56.847793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:56.848678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:56.849158 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:56.953075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for project 281651371cba4d4a9454b0747947cc83. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:35:56.967027 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for user 3e4ed08c1c81453abaa6c1dd826f0258 and project 281651371cba4d4a9454b0747947cc83. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:35:56.982359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:56.996212 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:35:57.000267 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:35:57.001839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-58f1cf7f-135e-44f6-a40a-810cbffd9f94 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 1.279602 Jun 24 10:35:57.003327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 23/46] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:55 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:57.018829 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:57.020512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:57.055441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:57.058079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:57.064670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:57.067766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:57.133933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c7006627-360d-4c21-9a09-86d795a42f4b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.300203 Jun 24 10:35:57.141874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 24/47] 10.222.0.69 () {62 vars in 1187 bytes} [Fri Jun 24 10:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3309 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 10:35:57.158202 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:57.159569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:57.170420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:57.171514 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:57.174116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:57.176549 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:57.449253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:57.464147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-13b95dca-5397-4c7c-910d-b922f746c560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1217 microversion: 2.1 time: 0.459721 Jun 24 10:35:57.467189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:57 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1217 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:57.478463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:57.489893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:57.524634 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:57.556500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7c054c61-42f8-4f97-a53b-8a82b2c5bd46 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1295 microversion: 2.1 time: 0.393080 Jun 24 10:35:57.566845 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 25/49] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:57 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1295 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:57.863011 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4361f00e-ff04-4c5a-8a62-9602d6492155 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1763d23dc0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:58.070004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4361f00e-ff04-4c5a-8a62-9602d6492155 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/5acaf0df-afe5-4593-9001-b9abe152dbb3" status: 200 len: 351 microversion: 2.1 time: 0.211311 Jun 24 10:35:58.071986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 26/50] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:35:57 2022] GET /compute/v2.1/os-volumes/5acaf0df-afe5-4593-9001-b9abe152dbb3 => generated 351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:58.084463 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:58.085487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:58.111892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:58.114691 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:58.118920 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:58.122762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:58.292341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:58.305161 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:58.310205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:58.312505 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2482dd1b-980b-4671-8bf3-fae03114388a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1281 microversion: 2.20 time: 0.843358 Jun 24 10:35:58.314419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:35:57 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1281 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:35:58.321334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e5f7c88e-f70b-41c4-b872-332b028f8418 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1763564280>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:58.565854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e5f7c88e-f70b-41c4-b872-332b028f8418 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.249390 Jun 24 10:35:58.567028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 26/52] 10.222.0.69 () {58 vars in 1133 bytes} [Fri Jun 24 10:35:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:58.582063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:58.584037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:58.601984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:58.605507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:58.609861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:58.612500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.360625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.374196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-dc32d96a-8cf5-423d-a7ad-e40438bbc2e5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1279 microversion: 2.1 time: 0.805624 Jun 24 10:35:59.385281 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 27/53] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:58 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1279 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:59.417222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:59.417903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:59.447774 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.450695 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.455761 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.457445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.490074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.504422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2f56b836-d910-4d41-90dc-22d692fd8d8e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 1.427266 Jun 24 10:35:59.506218 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 27/54] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:58 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:59.517460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-dc8f54e4-c4ac-4fc3-b6ca-97da4b948b97 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1763d23af0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:59.591612 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.600671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-90ee376c-3703-4ad1-a16b-7b92081f7c3f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1295 microversion: 2.1 time: 0.209445 Jun 24 10:35:59.601792 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 28/55] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:35:59 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1295 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:59.609804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:59.610631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:35:59.621686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.622379 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.624490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.625775 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.633743 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-dc8f54e4-c4ac-4fc3-b6ca-97da4b948b97 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.120178 Jun 24 10:35:59.634490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 28/56] 10.222.0.69 () {58 vars in 1148 bytes} [Fri Jun 24 10:35:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:35:59.712211 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.724543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.726782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:35:59.728087 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ef2c40f3-4522-4e6f-a08e-2bc5b60b2584 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1333 microversion: 2.20 time: 0.125199 Jun 24 10:35:59.729179 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 29/57] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:35:59 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:35:59.734286 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8d28694b-c474-49d3-a549-2aa5a608f04a tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1762d03280>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:59.828685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-8611f029-73e8-485c-a572-7c456d2ebe2f req-af8e4f10-cdf5-47c1-b102-7a63e4b27511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abab2387-4b51-43c6-a5dd-35ba2be20a1c", "tag": "f18eb70a-2116-44a2-9bd1-bd3fe894cb61"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:35:59.842197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8611f029-73e8-485c-a572-7c456d2ebe2f req-af8e4f10-cdf5-47c1-b102-7a63e4b27511 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.842616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8611f029-73e8-485c-a572-7c456d2ebe2f req-af8e4f10-cdf5-47c1-b102-7a63e4b27511 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.844619 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8d28694b-c474-49d3-a549-2aa5a608f04a tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.114151 Jun 24 10:35:59.851905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 30/58] 10.222.0.69 () {58 vars in 1133 bytes} [Fri Jun 24 10:35:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:35:59.857128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a47bb96d-408f-4409-84fa-248aaf982de0 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f17635641f0>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:35:59.877981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-8611f029-73e8-485c-a572-7c456d2ebe2f req-af8e4f10-cdf5-47c1-b102-7a63e4b27511 service nova] Creating event network-changed:f18eb70a-2116-44a2-9bd1-bd3fe894cb61 for instance abab2387-4b51-43c6-a5dd-35ba2be20a1c on hv-cinder-84753 Jun 24 10:35:59.878516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8611f029-73e8-485c-a572-7c456d2ebe2f req-af8e4f10-cdf5-47c1-b102-7a63e4b27511 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:35:59.879865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.880033 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.881012 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:35:59.881728 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:35:59.893789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.compute.rpcapi [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:35:59.894986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] Releasing lock "compute-rpcapi-router" {{(pid=124304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:35:59.947294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-70483b9a-69b8-407d-99a0-7b7e0b337856 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311569 Jun 24 10:35:59.948128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 29/59] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:00.022940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a47bb96d-408f-4409-84fa-248aaf982de0 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169643 Jun 24 10:36:00.023771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 31/60] 10.222.0.69 () {58 vars in 1166 bytes} [Fri Jun 24 10:35:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:36:00.039972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-eb8426c4-cfaf-421e-a11b-6b050706d5ca tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1763d23310>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.205261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-eb8426c4-cfaf-421e-a11b-6b050706d5ca tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.171163 Jun 24 10:36:00.205863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 30/61] 10.222.0.69 () {58 vars in 1169 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:00.218070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-24f52527-2c24-46e7-a3e2-71260bee1059 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1762d2cdc0>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.325970 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-24f52527-2c24-46e7-a3e2-71260bee1059 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.112015 Jun 24 10:36:00.326900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 32/62] 10.222.0.69 () {58 vars in 1154 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:00.342661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-43b60240-ca0c-4f94-bda5-b526c81ea2a3 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1762cbc9d0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.391428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.392199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:00.404085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.404541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:00.405354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.405795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:00.525072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-43b60240-ca0c-4f94-bda5-b526c81ea2a3 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189280 Jun 24 10:36:00.525838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 31/63] 10.222.0.69 () {58 vars in 1187 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:00.531539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.532714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:00.544231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.544763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:00.545700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.546874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:00.565773 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:00.575816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4599c9df-656f-4eac-92a5-bc6aafe3b45a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1279 microversion: 2.1 time: 0.188144 Jun 24 10:36:00.588108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 33/64] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:00.594802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-53435098-b047-4b2d-b9fc-4a6ace527731 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] Calling method '.version_select at 0x7f1762d03310>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.717662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-53435098-b047-4b2d-b9fc-4a6ace527731 tempest-VolumesTestJSON-616194154 tempest-VolumesTestJSON-616194154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.127990 Jun 24 10:36:00.718854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 34/65] 10.222.0.69 () {58 vars in 1154 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:00.729451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:00.732702 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:00.750526 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.752430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:00.755006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:00.755299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:01.084692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:01.095447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-902212bf-4d58-41e7-a5b9-776e1f52c16e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.567487 Jun 24 10:36:01.106154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 32/66] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:01.111556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:01.112253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:01.119094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:01.119617 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:01.120457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:01.120994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:01.229029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:01.237976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:01.239652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:01.242085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:01.244295 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-779aed23-8b6c-4047-b733-c70f9eb50e1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1339 microversion: 2.20 time: 0.136096 Jun 24 10:36:01.246964 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:01 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:01.261787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-440c4093-532d-4755-9771-5ae7b3fd4255 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.541458 Jun 24 10:36:01.262458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:00 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:01.595086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:01.596422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:01.609147 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:01.609616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:01.610579 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:01.611286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.055036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:02.064273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5c9e9a96-83c3-413c-ac65-b19aec93f509 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.473774 Jun 24 10:36:02.067967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 34/69] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:01 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:02.120138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:02.121759 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:02.138019 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.138605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.140116 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.140698 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.267122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:02.275694 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:02.292987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.293670 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.294623 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.297944 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.484607 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:02.488065 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=61 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:02.509842 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:02.512045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:02.514098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9498bea6-8751-4c52-8287-b67f3ddd85d7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1339 microversion: 2.20 time: 0.250565 Jun 24 10:36:02.515389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 35/70] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:02 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1339 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:02.521679 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:02.523925 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:02.527618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:02.533345 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.534086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.535320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:02.535944 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:02.654265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:02.657243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=71 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:02.670104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-734413ae-06f5-4c16-9695-4e510763a78e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.560940 Jun 24 10:36:02.672904 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 36/71] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:02 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:03.086491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:03.087553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:03.096521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:03.098990 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.101390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.102383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.113868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.299026 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:03.318081 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-43297cfd-e519-4122-9462-e9b576dae5a2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.796007 Jun 24 10:36:03.332276 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 36/72] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:02 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:03.618654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-6d6a3dc2-5f13-43ba-a0ff-7e7d8a742818 req-bd10dca3-814f-4172-92d8-15f83af59389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332b01da-30de-4466-9408-485f644e52f7", "tag": "60ac0302-9580-42af-834e-0673bcdbf476"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:03.628871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:03.638248 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6d6a3dc2-5f13-43ba-a0ff-7e7d8a742818 req-bd10dca3-814f-4172-92d8-15f83af59389 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.638695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6d6a3dc2-5f13-43ba-a0ff-7e7d8a742818 req-bd10dca3-814f-4172-92d8-15f83af59389 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.647456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-02cfc57b-25d7-4867-93de-3bf16c4bacb0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.564809 Jun 24 10:36:03.652354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 37/73] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:03 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:03.658674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:03.659605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:03.666920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.667429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.668599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.668814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.691687 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-6d6a3dc2-5f13-43ba-a0ff-7e7d8a742818 req-bd10dca3-814f-4172-92d8-15f83af59389 service nova] Creating event network-changed:60ac0302-9580-42af-834e-0673bcdbf476 for instance 332b01da-30de-4466-9408-485f644e52f7 on hv-cinder-84753 Jun 24 10:36:03.705206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-6d6a3dc2-5f13-43ba-a0ff-7e7d8a742818 req-bd10dca3-814f-4172-92d8-15f83af59389 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367270 Jun 24 10:36:03.710438 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 37/74] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:03.717422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:03.718289 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:03.726703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.727217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:03.728027 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:03.728427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.033836 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.069382 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.075190 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.078750 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-de45d03d-ddc0-49a3-afc1-9f5b8418dfa7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.424856 Jun 24 10:36:04.081102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 38/75] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:03 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:04.168491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.180757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-416d527c-7e84-4ce4-a4ce-1187e8b8872b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.468708 Jun 24 10:36:04.181735 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 38/76] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:03 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:04.348614 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:04.350019 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:04.378051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:04.378742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.381295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:04.381484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-ce55426c-6826-4422-9a1f-3c4f322ac440 req-79b5ae21-ee0e-4dcd-ab5e-8e5d83d6852e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e28d99-9c93-4c12-922b-a8a0bafae207", "tag": "e14124f9-29f1-48ef-b539-1d53a03433bb"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:04.382950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.394272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-ce55426c-6826-4422-9a1f-3c4f322ac440 req-79b5ae21-ee0e-4dcd-ab5e-8e5d83d6852e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:04.396348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-ce55426c-6826-4422-9a1f-3c4f322ac440 req-79b5ae21-ee0e-4dcd-ab5e-8e5d83d6852e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.415815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-ce55426c-6826-4422-9a1f-3c4f322ac440 req-79b5ae21-ee0e-4dcd-ab5e-8e5d83d6852e service nova] Creating event network-changed:e14124f9-29f1-48ef-b539-1d53a03433bb for instance 22e28d99-9c93-4c12-922b-a8a0bafae207 on hv-cinder-84753 Jun 24 10:36:04.421583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-ce55426c-6826-4422-9a1f-3c4f322ac440 req-79b5ae21-ee0e-4dcd-ab5e-8e5d83d6852e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044043 Jun 24 10:36:04.422400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 39/77] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:36:04.595631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.604186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2d4c3173-bf70-41d6-80bf-5900dea738e6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.260620 Jun 24 10:36:04.605045 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 39/78] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:04 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:04.668980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:04.669991 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:04.677233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:04.677982 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.678907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:04.679339 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:04.813498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:04.821644 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9d5b5cdc-912b-416d-8e79-8cf417c6716f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.156988 Jun 24 10:36:04.822221 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 40/79] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:04 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:05.098348 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:05.099228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:05.101261 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=4 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:05.106813 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.107261 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.108723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.109345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.198373 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:05.198981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:05.210030 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.210482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.211384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.211817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.295842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:05.303771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:05.305219 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:05.306535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-bdaceedd-6145-4a57-baaa-cca01dc3d04d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.212132 Jun 24 10:36:05.307093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 40/80] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:05 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:05.368661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:05.377898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-119b1198-4635-476d-aeca-23e78e80e0c8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.183325 Jun 24 10:36:05.378464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 41/81] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:05 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:05.620456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:05.621103 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:05.630125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.630588 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.631334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.631766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.721833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-b25d4802-4783-46bd-9b97-f195dbed2813 req-0ca169b1-a624-496c-99c5-bee5d7c5f46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e01d68-1575-4d74-8a50-e28d234be279", "tag": "d611db02-d3d2-4654-b123-836d4c7a6d99"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:05.731590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b25d4802-4783-46bd-9b97-f195dbed2813 req-0ca169b1-a624-496c-99c5-bee5d7c5f46c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.732268 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b25d4802-4783-46bd-9b97-f195dbed2813 req-0ca169b1-a624-496c-99c5-bee5d7c5f46c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.748480 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-b25d4802-4783-46bd-9b97-f195dbed2813 req-0ca169b1-a624-496c-99c5-bee5d7c5f46c service nova] Creating event network-changed:d611db02-d3d2-4654-b123-836d4c7a6d99 for instance 21e01d68-1575-4d74-8a50-e28d234be279 on hv-cinder-84753 Jun 24 10:36:05.754423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-b25d4802-4783-46bd-9b97-f195dbed2813 req-0ca169b1-a624-496c-99c5-bee5d7c5f46c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Jun 24 10:36:05.755897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 42/82] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:05.844491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:05.845836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:05.853812 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.854330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.855467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:05.855952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:05.920531 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:05.930300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ee0ebb9a-1a17-4193-94cb-a3c8ae948b1d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.313167 Jun 24 10:36:05.931106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 41/83] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:05 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:06.324694 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:06.326154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:06.335472 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.336915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:06.338057 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.338546 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:06.550453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:06.560461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-da415daa-a818-46c9-8c0b-8f617bc7a8e1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.724751 Jun 24 10:36:06.561349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 43/84] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:05 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:06.567324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:06.568695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:06.576779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.577498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:06.578504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.578926 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:06.592425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:06.622203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:06.624017 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:06.625203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ca68060f-ccd7-452c-b141-8fc12650fcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.304461 Jun 24 10:36:06.625770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 42/85] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:06 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:36:06.737665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:06.745797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-875c5eda-4bf7-433c-9ba9-c24a82621417 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.183201 Jun 24 10:36:06.746439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 44/86] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:06 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:06.948011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:06.949071 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:06.958339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.959478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:06.960618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:06.961774 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.160199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.168304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-66ec7edb-e4e0-4af0-8b39-3296e7e1c797 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.224735 Jun 24 10:36:07.168891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 43/87] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:06 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:07.580623 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:07.581594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:07.584468 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=12 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:07.593344 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.594227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.595385 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.596071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.643860 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:07.645355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:07.652853 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.653301 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.654060 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.654486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.806216 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.815055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-221bfcc9-6754-41b7-b76e-7715b4109a9c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.240144 Jun 24 10:36:07.815904 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 45/88] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:07 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:07.820653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:07.821293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:07.829154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.834534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.836928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.837731 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.838171 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.846352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.847916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.849082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ac07cdaf-d61b-4d97-92f5-5371a94c79e5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.209462 Jun 24 10:36:07.849644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 44/89] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:07 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:07.854359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-6a77593a-7032-413c-88db-220f1330e228 req-35adc334-034b-428b-a10f-4987cd39b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:07.866773 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-6a77593a-7032-413c-88db-220f1330e228 req-35adc334-034b-428b-a10f-4987cd39b0a0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.867340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-6a77593a-7032-413c-88db-220f1330e228 req-35adc334-034b-428b-a10f-4987cd39b0a0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.889393 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-6a77593a-7032-413c-88db-220f1330e228 req-35adc334-034b-428b-a10f-4987cd39b0a0 service nova] Creating event network-changed:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:36:07.890004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-6a77593a-7032-413c-88db-220f1330e228 req-35adc334-034b-428b-a10f-4987cd39b0a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:36:07.891389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.891913 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.893801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:07.894171 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:07.904979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.compute.rpcapi [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:36:07.906080 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] Releasing lock "compute-rpcapi-router" {{(pid=124303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:36:07.924591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5c61ba4c-3e2d-4fab-a5a9-19553fd18baf None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072747 Jun 24 10:36:07.925254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 45/90] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:07.980181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:07.988724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-86448ac1-c15a-4f09-8454-aa1dd4d8451e tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.171655 Jun 24 10:36:07.989402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 46/91] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:07 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:08.186295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:08.187125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:08.194649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.195024 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:08.195801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.196228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:08.302122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=30 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:08.334496 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:08.342463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-988c0f1d-8dbf-4235-96bc-1d753922dd0f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.160462 Jun 24 10:36:08.343039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 46/92] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:08 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:08.833378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:08.834008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:08.851554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.852325 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:08.857718 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.859338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:08.868067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:08.869290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:08.879321 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.883540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:08.884599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:08.886126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:09.271319 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.274726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.285383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0e10bc39-90f2-4ae7-89f2-efcecd159f56 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.457410 Jun 24 10:36:09.286103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 47/93] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:08 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:09.287829 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.289678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.290539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:09.291142 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:09.291743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8b42f1a2-c1f4-428d-ab71-64810e84b826 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.427557 Jun 24 10:36:09.292485 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 47/94] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:08 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:09.307056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:09.308408 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:09.309388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:09.309994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:09.359492 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:09.360188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:09.367559 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:09.368196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:09.369179 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:09.369793 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:09.621822 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.630038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-afaa4e07-7670-4e0d-936a-9de0aebdffca tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.343060 Jun 24 10:36:09.637390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 48/95] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:09 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:09.670737 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:09.691084 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5724b148-efcc-412a-9e81-9ba98e0ac2ab tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.335395 Jun 24 10:36:09.691849 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 48/96] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:09 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:10.304975 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:10.306225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:10.315836 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:10.317168 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:10.326758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.328454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:10.329197 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.331403 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.332550 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.333345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.337407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.338508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.339175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.704368 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:10.707166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:10.723556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:10.724454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-87698734-525e-46b7-b9aa-03e22a10a9e4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.425712 Jun 24 10:36:10.725090 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 49/97] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:10 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:10.725202 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:10.726408 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5fb1023e-beb0-44cf-8cf7-b22e03bcbea2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.414557 Jun 24 10:36:10.726972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 49/98] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:10 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:10.732724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:10.734063 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:10.737505 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:10.738112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:10.742049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.743000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.743901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.744396 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.749754 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.750451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.751199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:10.751677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:10.935356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:10.943466 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4784494c-d800-43c7-bd0f-b1bf8c6b20a9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.215704 Jun 24 10:36:10.944066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 50/99] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:10 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:11.083316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:11.094385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-623ac43e-7cdc-4158-a416-f65ebae56f42 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.366378 Jun 24 10:36:11.099515 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 50/100] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:10 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:11.515296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-022637c7-b055-400e-9594-883db159583d req-243ed2b8-c532-4d2f-ad46-5d7c737c34ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abab2387-4b51-43c6-a5dd-35ba2be20a1c", "name": "network-vif-plugged", "status": "completed", "tag": "f18eb70a-2116-44a2-9bd1-bd3fe894cb61"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:11.526430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-022637c7-b055-400e-9594-883db159583d req-243ed2b8-c532-4d2f-ad46-5d7c737c34ee service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:11.527099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-022637c7-b055-400e-9594-883db159583d req-243ed2b8-c532-4d2f-ad46-5d7c737c34ee service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:11.543700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-022637c7-b055-400e-9594-883db159583d req-243ed2b8-c532-4d2f-ad46-5d7c737c34ee service nova] Creating event network-vif-plugged:f18eb70a-2116-44a2-9bd1-bd3fe894cb61 for instance abab2387-4b51-43c6-a5dd-35ba2be20a1c on hv-cinder-84753 Jun 24 10:36:11.550795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-022637c7-b055-400e-9594-883db159583d req-243ed2b8-c532-4d2f-ad46-5d7c737c34ee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144899 Jun 24 10:36:11.551634 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 51/101] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:11.745200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:11.746136 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:11.748375 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:11.750371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:11.754679 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:11.755124 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:11.757741 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:11.758204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:11.761085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:11.761950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:11.763004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:11.763797 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:12.022314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.025802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.044843 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-839a973b-095e-4b81-b65d-4ab86e5d95d9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.303570 Jun 24 10:36:12.046980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 51/102] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:11 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:12.048079 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.054033 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.057941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-129ffc37-2451-4c2a-b5e3-a90c2c19981c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.315673 Jun 24 10:36:12.058661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 52/103] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:11 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:12.061503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:12.062276 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:12.070553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:12.070928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:12.071919 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:12.072830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:12.118491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:12.119381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:12.129067 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:12.134959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:12.136152 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:12.136597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:12.747487 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.756350 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9eba437f-e7c4-4649-924f-ad68688571b8 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.707296 Jun 24 10:36:12.769579 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 52/104] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:12 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:12.802349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:12.814897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ec0b1368-c6e7-4c01-ad0f-b9fe003905d8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.701235 Jun 24 10:36:12.815491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 53/105] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:12 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:13.069237 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:13.069997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:13.076886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:13.077821 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:13.090928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.091366 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.093949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.094815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.098105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.098565 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.099408 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.099847 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.488850 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:13.498633 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:13.499512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=100 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:13.503805 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d34499a9-b45b-4e0d-85e0-2d59923f7b84 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.443987 Jun 24 10:36:13.504845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 53/106] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:13 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:13.514432 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:13.514432 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:13.514432 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1baef6b6-f2d5-4d4d-a165-97724f329d08 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.438901 Jun 24 10:36:13.515293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 54/107] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:13 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:13.776009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:13.777148 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:13.783523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.787536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.788499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.790238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.799742 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=100 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:13.832791 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:13.834132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:13.846946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.847862 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:13.848982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:13.849882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:14.102721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.113249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bdce5ece-5952-4830-a867-9be5c4931c71 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.340863 Jun 24 10:36:14.114455 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 55/108] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:13 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:14.120310 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.129227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7e09e460-d650-4d88-a61b-db194ced821e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.301479 Jun 24 10:36:14.141042 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 54/109] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:13 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:14.526637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:14.526637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:14.528809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:14.529802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:14.532192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:14.533504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:14.534788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:14.541716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:14.546784 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:14.550932 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:14.554401 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:14.554994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:14.785478 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.793722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d392c14a-0282-4ece-a606-9a817fa0d388 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.275187 Jun 24 10:36:14.797001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 56/110] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:14 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:14.833883 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.846297 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.848491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:14.851623 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-df486759-c715-4fc3-b454-2a257a379be3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.326532 Jun 24 10:36:14.863400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 55/111] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:14 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:15.124369 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-d3897aea-0072-4dc9-9bd3-83a9321b92fa req-377b8196-8b35-4fae-af37-b4631859fbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332b01da-30de-4466-9408-485f644e52f7", "name": "network-vif-plugged", "status": "completed", "tag": "60ac0302-9580-42af-834e-0673bcdbf476"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:15.131028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:15.131785 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:15.137104 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-d3897aea-0072-4dc9-9bd3-83a9321b92fa req-377b8196-8b35-4fae-af37-b4631859fbc5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.137560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-d3897aea-0072-4dc9-9bd3-83a9321b92fa req-377b8196-8b35-4fae-af37-b4631859fbc5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.142993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.154633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.155735 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-d3897aea-0072-4dc9-9bd3-83a9321b92fa req-377b8196-8b35-4fae-af37-b4631859fbc5 service nova] Creating event network-vif-plugged:60ac0302-9580-42af-834e-0673bcdbf476 for instance 332b01da-30de-4466-9408-485f644e52f7 on hv-cinder-84753 Jun 24 10:36:15.155855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.156083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.171011 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-d3897aea-0072-4dc9-9bd3-83a9321b92fa req-377b8196-8b35-4fae-af37-b4631859fbc5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050122 Jun 24 10:36:15.176311 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 57/112] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:15.187886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:15.188660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:15.203287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.203724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.206301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.206899 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.545678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:15.559205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e6338e3e-6c1e-482a-b223-e38f77c6bb2c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1315 microversion: 2.1 time: 0.432116 Jun 24 10:36:15.560079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 56/113] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:15 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:15.586730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:15.607459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-86c29aa6-1dd3-4cc1-8cbe-031f290e28a1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.429626 Jun 24 10:36:15.608069 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 58/114] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:15 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:15.817746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:15.819795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:15.859944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.862514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.868621 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.869928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.872523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:15.873173 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:15.886073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.886522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:15.887297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:15.887726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:16.173055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.183162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.191087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.192522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3a71da31-f1e0-4d20-81a1-f9b9ce1c356a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.324213 Jun 24 10:36:16.193261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 59/115] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:15 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:36:16.286765 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.300091 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7416608c-e2db-4f48-b3b9-16b08879f012 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.487767 Jun 24 10:36:16.301315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 57/116] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:15 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:16.577146 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:16.577790 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:16.585524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:16.586206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:16.586977 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:16.587595 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:16.625918 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:16.626730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:16.633974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:16.634730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:16.635655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:16.636230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:16.818454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.824072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:16.828016 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6768965b-e8de-4d03-8240-fe034f52002a tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1501 microversion: 2.1 time: 0.254937 Jun 24 10:36:16.829861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 60/117] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:16 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:16.833728 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-27fd09ce-f10d-4ab6-93a3-a6a58d900ef9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.211836 Jun 24 10:36:16.844017 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 58/118] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:16 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:17.213751 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:17.214356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:17.225664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.226472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.228022 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.228661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.319480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:17.320095 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:17.332014 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.332576 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.334731 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.335390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.399436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:17.407919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:17.409703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:17.410827 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9fc341b2-bd15-487f-991a-2ac98bd7cf73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.201743 Jun 24 10:36:17.411384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 61/119] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:17 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:17.515311 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:17.525864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0b8751e9-0996-43d1-a579-216ded3cce18 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.210198 Jun 24 10:36:17.526445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 59/120] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:17 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:17.851300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:17.851911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:17.858698 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.859144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.859973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:17.860407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:17.997727 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:18.005775 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-41b7c465-72ae-4afc-8bba-41838df7db37 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.158050 Jun 24 10:36:18.006382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 62/121] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:17 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:18.429440 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:18.430055 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:18.433004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:18.436545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:18.437015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:18.437780 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:18.438650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:18.544445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:18.545088 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:18.553310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:18.553757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:18.554544 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:18.554973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:18.651059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:18.662586 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:18.662870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:18.664760 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-89ae1a48-8a8a-4485-8d72-d0e8f2123d61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.239677 Jun 24 10:36:18.666820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 60/122] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:18 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:36:18.751843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:18.758435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-93fb3368-1def-4ba4-8368-20cbbc0af8eb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.219093 Jun 24 10:36:18.759015 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 63/123] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:18 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:19.022867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:19.023576 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:19.029809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.030255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.031003 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.031438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.184494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:19.200077 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-227b108f-d447-4948-b1b2-118a9e224f11 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.180600 Jun 24 10:36:19.201036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 61/124] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:19 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:19.340426 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91e1a0cb-3f42-4d70-b0c8-8a344f82cd2d"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:19.343283 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:19.352310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.352881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.353731 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.354235 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.684463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:19.685093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:19.706512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.709017 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.712221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.712827 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.946038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-33a132cb-b340-48c0-b9ed-c8c286f29ac9 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "POST /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.610898 Jun 24 10:36:19.952833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 64/125] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:36:19 2022] POST /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:19.966207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:19.967009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:19.997587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.998108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:19.998864 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:19.999294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:20.010544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:20.024544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:20.027161 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:20.033185 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-97b4d215-abda-4232-bb54-94411a8b2d93 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.352361 Jun 24 10:36:20.035660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 62/126] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:19 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:20.220430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:20.221631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:20.240138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:20.240598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:20.241415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:20.242902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:20.244160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:20.256250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0aa9a1bd-a570-43b4-a0fa-94c4b4472c98 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.302152 Jun 24 10:36:20.257131 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 65/127] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:19 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:20.343445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f9ad815f-1c37-4664-bfd8-24b9f27f5227 req-391cd7c4-f3ae-43c1-8a48-444baa1542e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "name": "network-vif-plugged", "status": "completed", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:20.365755 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f9ad815f-1c37-4664-bfd8-24b9f27f5227 req-391cd7c4-f3ae-43c1-8a48-444baa1542e8 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:20.367602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f9ad815f-1c37-4664-bfd8-24b9f27f5227 req-391cd7c4-f3ae-43c1-8a48-444baa1542e8 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:20.415056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f9ad815f-1c37-4664-bfd8-24b9f27f5227 req-391cd7c4-f3ae-43c1-8a48-444baa1542e8 service nova] Creating event network-vif-plugged:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:36:20.429527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f9ad815f-1c37-4664-bfd8-24b9f27f5227 req-391cd7c4-f3ae-43c1-8a48-444baa1542e8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091170 Jun 24 10:36:20.432066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 66/128] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:36:20.534789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:20.551351 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2c3eaac2-2e04-4665-a8dd-21e7cf9b6e56 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1363 microversion: 2.1 time: 0.336172 Jun 24 10:36:20.556544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 63/129] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:20 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:21.053680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:21.054525 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:21.062873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.063483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.064578 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.065107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.265437 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:21.275294 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:21.277482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:21.280198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:21.281983 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:21.284346 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2161b304-d55c-4e70-a877-f5f6357fa773 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.235778 Jun 24 10:36:21.286373 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.287124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.288113 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.288777 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.295677 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 67/130] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:21 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:21.436830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:21.445143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f89c2161-51ca-454a-8dde-5d0163b64a04 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.174254 Jun 24 10:36:21.445946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 64/131] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:21 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:21.567992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:21.568541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:21.574620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.575352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.576358 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.577343 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.775477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:21.793085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f544d328-4b45-4e0a-8e43-6c93d02a833f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1548 microversion: 2.1 time: 0.229422 Jun 24 10:36:21.801037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 68/132] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:21 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:21.811121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:21.811604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:21.822380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.823092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.824260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:21.824972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:21.976295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c3adf233-e5c0-4504-9c6c-cb7d190c4478 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169092 Jun 24 10:36:21.976917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 65/133] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:36:21 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:36:22.303842 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:22.304615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:22.322069 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:22.324494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:22.327313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:22.329324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:22.473496 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:22.475168 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:22.488959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:22.491663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:22.494714 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:22.495996 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:22.762730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:22.780670 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:22.782521 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:22.783916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4f3fa349-56ec-4d6a-9466-c59528a01c91 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1407 microversion: 2.20 time: 0.484686 Jun 24 10:36:22.784696 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 69/134] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:22 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:22.792374 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e01d68-1575-4d74-8a50-e28d234be279", "name": "network-vif-plugged", "status": "completed", "tag": "d611db02-d3d2-4654-b123-836d4c7a6d99"}, {"server_uuid": "22e28d99-9c93-4c12-922b-a8a0bafae207", "name": "network-vif-plugged", "status": "completed", "tag": "e14124f9-29f1-48ef-b539-1d53a03433bb"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:22.825921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:22.837525 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:22.861213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] Creating event network-vif-plugged:d611db02-d3d2-4654-b123-836d4c7a6d99 for instance 21e01d68-1575-4d74-8a50-e28d234be279 on hv-cinder-84753 Jun 24 10:36:22.861721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] Creating event network-vif-plugged:e14124f9-29f1-48ef-b539-1d53a03433bb for instance 22e28d99-9c93-4c12-922b-a8a0bafae207 on hv-cinder-84753 Jun 24 10:36:22.882587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-5dba9d24-d629-483f-8d53-6314859bb552 req-e91a407c-ce42-41e6-98ef-3bac623d9d4b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096414 Jun 24 10:36:22.887406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 70/135] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:22.965892 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:22.991436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-221b43d9-1c12-493d-9c16-c011dd470d5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.531116 Jun 24 10:36:22.995331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 66/136] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:22 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:23.803816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:23.805563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:23.813538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:23.814382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:23.815345 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:23.816072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.011604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:24.012153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:24.023959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:24.024917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.026107 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:24.026785 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.042503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:24.054000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:24.055506 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:24.073602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-02045af7-e920-44ef-a9d0-fb14a2423a48 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1598 microversion: 2.20 time: 0.260601 Jun 24 10:36:24.074421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 71/137] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:36:23 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1598 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:36:24.102132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:24.103630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:24.112890 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:24.114085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.115186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:24.115713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.150404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:24.384391 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1a40f1f4-2a68-49a4-b56e-f0297cace248 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.295630 Jun 24 10:36:24.385134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 72/138] 10.222.0.69 () {60 vars in 1315 bytes} [Fri Jun 24 10:36:24 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:36:24.398564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:24.403387 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-120fceec-dd6b-4a6c-9218-4d7d361825d3 req-d7a4307a-f174-4253-9aaa-bbcafbdfc617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332b01da-30de-4466-9408-485f644e52f7", "tag": "60ac0302-9580-42af-834e-0673bcdbf476"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:24.406926 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-55fcef79-38e8-4c87-8900-87a0bd7bb3e0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.399262 Jun 24 10:36:24.408657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 67/139] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:24 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:24.431923 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-120fceec-dd6b-4a6c-9218-4d7d361825d3 req-d7a4307a-f174-4253-9aaa-bbcafbdfc617 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:24.432513 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-120fceec-dd6b-4a6c-9218-4d7d361825d3 req-d7a4307a-f174-4253-9aaa-bbcafbdfc617 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:24.450913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-120fceec-dd6b-4a6c-9218-4d7d361825d3 req-d7a4307a-f174-4253-9aaa-bbcafbdfc617 service nova] Creating event network-changed:60ac0302-9580-42af-834e-0673bcdbf476 for instance 332b01da-30de-4466-9408-485f644e52f7 on hv-cinder-84753 Jun 24 10:36:24.457887 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-120fceec-dd6b-4a6c-9218-4d7d361825d3 req-d7a4307a-f174-4253-9aaa-bbcafbdfc617 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071453 Jun 24 10:36:24.461678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 73/140] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:25.429187 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:25.430698 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:25.440726 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:25.441422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:25.442858 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:25.443789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:25.733289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:25.745880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1c7d4ba0-8558-460b-85fe-7f6dfec2283e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.324117 Jun 24 10:36:25.755474 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 68/141] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:25 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:26.541042 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-1f3ca25b-f7e7-4d63-8a95-187d853963fc req-e246ac55-ffd4-423a-b80c-78d5d6ca38b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:26.551187 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-1f3ca25b-f7e7-4d63-8a95-187d853963fc req-e246ac55-ffd4-423a-b80c-78d5d6ca38b0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:26.552725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-1f3ca25b-f7e7-4d63-8a95-187d853963fc req-e246ac55-ffd4-423a-b80c-78d5d6ca38b0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:26.566646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-1f3ca25b-f7e7-4d63-8a95-187d853963fc req-e246ac55-ffd4-423a-b80c-78d5d6ca38b0 service nova] Creating event network-changed:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:36:26.572492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-1f3ca25b-f7e7-4d63-8a95-187d853963fc req-e246ac55-ffd4-423a-b80c-78d5d6ca38b0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037873 Jun 24 10:36:26.573292 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 74/142] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:26.762524 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:26.763189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:26.770040 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:26.770710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:26.771633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:26.772232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:26.975517 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:26.983880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3abe1a19-a682-418e-82b7-061584bf158e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.224848 Jun 24 10:36:26.984871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 69/143] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:26 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:28.003182 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:28.004000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:28.010746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:28.011367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:28.012197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:28.012712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:28.156296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:28.164362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d20ca68e-0bc6-4ac5-aa61-d5fa0bd4fb74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1321 microversion: 2.1 time: 0.166564 Jun 24 10:36:28.165063 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 75/144] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:27 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:29.182743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:29.183441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:29.189753 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.190413 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.191269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.191695 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.320041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:29.323526 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=100 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:29.332778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cd375b99-3f55-4054-ac74-5261528039a5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1516 microversion: 2.1 time: 0.154655 Jun 24 10:36:29.333639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 70/145] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:29 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:29.354974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:29.355969 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:29.365169 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.365607 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.366364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.366790 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.391273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lazy-loading 'flavor' on Instance uuid 22e28d99-9c93-4c12-922b-a8a0bafae207 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:36:29.516780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c5ddf8c3-dc2a-4e63-978e-c35d5273ecaa tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207/action" status: 200 len: 32 microversion: 2.1 time: 0.165694 Jun 24 10:36:29.517330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 76/146] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:36:29 2022] POST /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:36:29.526813 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:29.527419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:29.534183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.534652 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.535434 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:29.535867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:29.670614 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:29.678672 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a5d304a4-724b-4474-b166-d9be94cbe8b1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.155921 Jun 24 10:36:29.679259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 71/147] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:29 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:30.701660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:30.702758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:30.715178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:30.715811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:30.717120 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:30.717879 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:30.860176 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:30.868371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4079dac3-80f3-4166-a37e-78132183c49a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.174759 Jun 24 10:36:30.868988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 77/148] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:30 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:31.890110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:31.890986 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:31.898730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:31.899176 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:31.899939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:31.900375 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:32.030195 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:32.038030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5f487f39-3b7a-4bb6-815e-75b4b8f9597b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.154718 Jun 24 10:36:32.038631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 72/149] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:31 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:33.055557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:33.056129 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:33.058718 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=84 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:33.064919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:33.065425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:33.066181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:33.066638 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:33.211800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:33.222005 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-71d8bc89-8d0a-4d3d-89d9-f6358af0b363 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.170272 Jun 24 10:36:33.222511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 78/150] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:33 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:34.239468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:34.239979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:34.241922 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=72 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:34.247453 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:34.247901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:34.248663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:34.249133 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:34.384982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:34.396067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d627fb01-10ae-413a-a565-144d9c51c241 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.160789 Jun 24 10:36:34.396639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 73/151] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:34 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:35.412532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:35.413326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:35.420924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:35.421431 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:35.422271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:35.422910 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:35.610353 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:35.623382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8dd95c25-c6b5-49bc-86de-9e01721206a9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.215107 Jun 24 10:36:35.626002 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 79/152] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:35 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:35.666981 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2138017860", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "networks": [{"uuid": "8892b172-ff9b-4970-9912-4cf3bdf6c7ce"}]}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:35.731859 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] validate_networks() for [('8892b172-ff9b-4970-9912-4cf3bdf6c7ce', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:36:36.108618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:36:36.109178 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:36:36.109856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:36:36.110417 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:36:36.111021 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:36:36.124945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:36.125431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:36.126559 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:36.127211 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:36.145938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Getting quotas for project 9513ee5af8e84d48a7f28b4c77db2dd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:36:36.149844 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Getting quotas for user 57e63c7198d2450698858f9b84393c43 and project 9513ee5af8e84d48a7f28b4c77db2dd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:36:36.161857 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:36:36.164104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:36:36.213452 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a4d3239c-62d9-48a5-a78e-f3c904ab90ee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550275 Jun 24 10:36:36.214074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 74/153] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:36:36.224504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6d2d5284-b65d-4482-b643-a269755cabcd tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:36.225131 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6d2d5284-b65d-4482-b643-a269755cabcd tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:36.282327 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6d2d5284-b65d-4482-b643-a269755cabcd tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:36.291040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6d2d5284-b65d-4482-b643-a269755cabcd tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1214 microversion: 2.1 time: 0.070472 Jun 24 10:36:36.291870 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 80/154] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:36 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:36.642637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:36.643243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:36.649359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:36.649794 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:36.650541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:36.650964 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:36.780267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:36.791030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-be185cde-d01a-456c-996d-524191941684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.152102 Jun 24 10:36:36.791821 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 75/155] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:36 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:37.309715 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:37.311224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:37.319093 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:37.319531 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:37.320264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:37.320688 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:37.389802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:37.398049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2f9e623e-4e0e-4211-99ae-a37fb3736b7a tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1218 microversion: 2.1 time: 0.094166 Jun 24 10:36:37.398628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 81/156] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:37 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:37.809553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:37.810275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:37.819288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:37.819734 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:37.820546 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:37.820999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:37.974668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:37.982838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-912f6d0b-e759-44bd-9eca-7bd4ef33e276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.178893 Jun 24 10:36:37.983660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 76/157] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:37 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:38.415480 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:38.416082 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:38.422701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:38.423146 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:38.423889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:38.424318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:38.485406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:38.494326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-98ac3b9e-5dcf-4f35-83ff-b1c2a8b422a6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1218 microversion: 2.1 time: 0.082738 Jun 24 10:36:38.494921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 82/158] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:38 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:38.999351 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:38.999965 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:39.008621 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.008868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.009625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.010048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.409894 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:39.419715 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-97c4a003-2c3a-4453-8727-020124f8747f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.424129 Jun 24 10:36:39.420293 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 77/159] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:38 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:39.511301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:39.512609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:39.527324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.527953 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.529760 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.530344 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.604066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:39.604554 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:39.609739 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:39.618859 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e1debd80-9824-44cd-ab7c-71b321733806 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1210 microversion: 2.1 time: 0.111743 Jun 24 10:36:39.624121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.624565 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.625092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 83/160] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:39 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:39.625904 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.626340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.655801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:36:39.783110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5b7a1113-24a6-4ece-aa82-4c68016e3c57 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "DELETE /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 204 len: 0 microversion: 2.1 time: 0.183907 Jun 24 10:36:39.784004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 78/161] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:36:39 2022] DELETE /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:36:39.791947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:39.792574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:39.798808 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.799246 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.800001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:39.800431 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:39.983830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:39.992536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-75ff79a5-cf98-43f3-b95b-0554de77dd2d tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1553 microversion: 2.1 time: 0.204443 Jun 24 10:36:39.993171 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 84/162] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:39 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:40.437783 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:40.439355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:40.447162 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:40.447872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:40.448930 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:40.449333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:40.603597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:40.611712 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5410b6a5-debd-4e21-b7be-cf58f0fcbdf3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.178147 Jun 24 10:36:40.612294 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 79/163] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:40 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:40.635814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:40.636536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:40.643401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:40.643847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:40.644711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:40.645278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:40.735761 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:40.743834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-429836ed-c302-4fc7-8372-949c2f24f4cf tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1266 microversion: 2.1 time: 0.111858 Jun 24 10:36:40.744587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 85/164] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:40 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:41.010446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:41.011362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:41.018715 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.019385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.020454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.021072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.168862 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:41.178982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-698542f0-2c7d-4f44-9d53-4d093c93b18c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1553 microversion: 2.1 time: 0.172589 Jun 24 10:36:41.179856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 80/165] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:41 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:41.629563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:41.630756 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:41.637449 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.638138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.638746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.639200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.763161 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:41.764522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:41.771974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.772601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.773605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:41.774266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:41.783901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:41.797235 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-94383081-cfc1-442b-b4f0-90c2834122ec tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.171696 Jun 24 10:36:41.798523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 86/166] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:41 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:41.851968 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:41.864820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e0a198b0-11d8-4731-87ab-5d5eb2b81e95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1266 microversion: 2.1 time: 0.105123 Jun 24 10:36:41.867496 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 81/167] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:41 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:42.202248 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:42.203260 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:42.217223 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.217668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:42.232990 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.232990 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:42.421120 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:42.433403 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f809de47-84d5-4f64-9519-16bde835b427 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1553 microversion: 2.1 time: 0.234905 Jun 24 10:36:42.436831 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 87/168] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:42 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:42.815929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:42.818020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:42.833697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.835069 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:42.837551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.838189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:42.883402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:42.884966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:42.896320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.906640 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:42.907690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:42.908266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:43.039156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:43.053122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c819d7d8-1d05-4463-b5cd-24070141125d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1272 microversion: 2.1 time: 0.172693 Jun 24 10:36:43.062787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 88/169] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:42 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:43.190149 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:43.199920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-86945a66-0f89-4d97-ae86-c91732164ef1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.388810 Jun 24 10:36:43.200624 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 82/170] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:42 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:43.451342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:43.452112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:43.459037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:43.459697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:43.461230 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:43.461998 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:43.706249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:43.709821 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:43.722318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8fdcedd6-8202-4f09-86f9-1aa0deeba15c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1553 microversion: 2.1 time: 0.274650 Jun 24 10:36:43.723861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 89/171] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:43 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:43.876762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-f7441063-e844-4395-b254-3f0926415c33 req-5356acd4-438e-4454-97e8-9c42fae27fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abab2387-4b51-43c6-a5dd-35ba2be20a1c", "name": "network-vif-deleted", "tag": "f18eb70a-2116-44a2-9bd1-bd3fe894cb61"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:43.899868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f7441063-e844-4395-b254-3f0926415c33 req-5356acd4-438e-4454-97e8-9c42fae27fee service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:43.900441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f7441063-e844-4395-b254-3f0926415c33 req-5356acd4-438e-4454-97e8-9c42fae27fee service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:43.939336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-f7441063-e844-4395-b254-3f0926415c33 req-5356acd4-438e-4454-97e8-9c42fae27fee service nova] Creating event network-vif-deleted:f18eb70a-2116-44a2-9bd1-bd3fe894cb61 for instance abab2387-4b51-43c6-a5dd-35ba2be20a1c on hv-cinder-84753 Jun 24 10:36:43.947767 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-f7441063-e844-4395-b254-3f0926415c33 req-5356acd4-438e-4454-97e8-9c42fae27fee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079733 Jun 24 10:36:43.948946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 83/172] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:44.072893 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:44.074101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:44.081780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.082310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.083160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.083642 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.219407 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:44.220134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:44.230446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.231062 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.232479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.233967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.393067 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:44.404070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-222e716c-b36f-4a77-abe8-a38b58672d5c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.334602 Jun 24 10:36:44.405192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 90/173] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:44 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:44.472819 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:44.491922 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-503ae704-d2fb-4e7c-9dd5-30122bfa913d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.277374 Jun 24 10:36:44.492442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 84/174] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:44 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:44.740195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:44.740837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:44.744938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-52aac736-b024-4433-904a-03adf55b97d2 req-bec72e96-5d5f-4fe5-9c17-5e65ae3e9d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe95bec9-042b-4a7c-872a-9b6aba0097d8", "tag": "79386655-e33a-42ef-9559-01bb458133a7"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:44.747075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.747516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.748264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.748875 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.753589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-52aac736-b024-4433-904a-03adf55b97d2 req-bec72e96-5d5f-4fe5-9c17-5e65ae3e9d31 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.754281 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-52aac736-b024-4433-904a-03adf55b97d2 req-bec72e96-5d5f-4fe5-9c17-5e65ae3e9d31 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.773072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-52aac736-b024-4433-904a-03adf55b97d2 req-bec72e96-5d5f-4fe5-9c17-5e65ae3e9d31 service nova] Creating event network-changed:79386655-e33a-42ef-9559-01bb458133a7 for instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 on hv-cinder-84753 Jun 24 10:36:44.778197 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-52aac736-b024-4433-904a-03adf55b97d2 req-bec72e96-5d5f-4fe5-9c17-5e65ae3e9d31 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037050 Jun 24 10:36:44.778989 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 85/175] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:44.783992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:44.784435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:44.784894 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lazy-loading 'fault' on Instance uuid abab2387-4b51-43c6-a5dd-35ba2be20a1c {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:36:44.830385 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16daeab4accb4eeca4100b55dc9bcaa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3d0adc7084828b9ed954edee54f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:44.839188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a6354648-b1b4-4e9c-b415-de15f4cc537b tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 200 len: 1351 microversion: 2.1 time: 0.103300 Jun 24 10:36:44.839755 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 91/176] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:44 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:45.422449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:45.423798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:45.434805 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:45.435822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:45.436861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:45.437472 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:45.510389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:45.511112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:45.529075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:45.529822 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:45.530952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:45.531741 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:45.999096 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:46.003405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:46.007246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c55bae8d-95cb-47c9-b8ec-73f475dbcbf0 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.588860 Jun 24 10:36:46.008041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 86/177] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:45 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:46.017503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-faa9632a-8912-4cdd-b597-3dab53643d88 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.509171 Jun 24 10:36:46.017503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 92/178] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:45 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:46.024108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:46.025101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:46.043203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:46.043746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:46.044411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:46.044873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:46.058631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] HTTP exception thrown: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Request method failure captured: Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c HTTP/1.1 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN0kJztO2AVMzC0obnKbRQfKa-tFUaHEpSSiE9pcu5U0EWH9lBJ9DQ6ZWZ-bp-_apnnn5arKqzc1dea5DNXFSabOuceObGk92mDo-GYk2Tf71XpoO0sUYDiUipZiEhwv-PIWRPcfgET3Yk2QK49db2GJLo1Bh6ezuDH2SnrX_mTvf0 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:36:46.063556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dee3d0adc7084828b9ed954edee54f6a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 16daeab4accb4eeca4100b55dc9bcaa2 Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.065144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'abab2387-4b51-43c6-a5dd-35ba2be20a1c'} Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:36:46.066048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.067539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.069939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Returning 404 to user: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:36:46.069939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-726b4e98-b9fb-4c64-ba25-697f74ad34ce tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 404 len: 111 microversion: 2.1 time: 0.045500 Jun 24 10:36:46.069939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 87/179] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:46 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:46.208297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:46.209404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:46.221058 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:46.221566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:46.222403 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:46.222949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:46.237008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] HTTP exception thrown: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Request method failure captured: Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c/os-volume_attachments HTTP/1.1 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN0kJztO2AVMzC0obnKbRQfKa-tFUaHEpSSiE9pcu5U0EWH9lBJ9DQ6ZWZ-bp-_apnnn5arKqzc1dea5DNXFSabOuceObGk92mDo-GYk2Tf71XpoO0sUYDiUipZiEhwv-PIWRPcfgET3Yk2QK49db2GJLo1Bh6ezuDH2SnrX_mTvf0 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:36:46.241462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dee3d0adc7084828b9ed954edee54f6a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 16daeab4accb4eeca4100b55dc9bcaa2 Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.243219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'server_id': 'abab2387-4b51-43c6-a5dd-35ba2be20a1c'} Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:36:46.244135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:46.245430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:46.246919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Returning 404 to user: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:36:46.247976 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-55541ce8-d693-4780-9dfc-1482574a6aa0 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044360 Jun 24 10:36:46.248833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 93/180] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:36:46 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:47.025076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:47.025737 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:47.028956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:47.029844 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:47.033657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:47.034128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.034267 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:47.034362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.035027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.035460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.037334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:47.042184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.042626 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.043378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.043793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.051850 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:47.233037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:47.236994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:47.240962 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a5f85e51-ac13-4e65-9bc9-421b48d34096 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.219809 Jun 24 10:36:47.242302 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 88/181] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:47 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:47.245274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b5879cab-5b6b-49bf-a055-86e848de8cd4 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.216366 Jun 24 10:36:47.245847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 94/182] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:47 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:47.472768 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:47.473326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:47.479876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.480319 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.481111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.481571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.495316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] HTTP exception thrown: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Request method failure captured: Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c HTTP/1.1 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN0kJztO2AVMzC0obnKbRQfKa-tFUaHEpSSiE9pcu5U0EWH9lBJ9DQ6ZWZ-bp-_apnnn5arKqzc1dea5DNXFSabOuceObGk92mDo-GYk2Tf71XpoO0sUYDiUipZiEhwv-PIWRPcfgET3Yk2QK49db2GJLo1Bh6ezuDH2SnrX_mTvf0 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:36:47.496957 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dee3d0adc7084828b9ed954edee54f6a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 16daeab4accb4eeca4100b55dc9bcaa2 Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.498275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'abab2387-4b51-43c6-a5dd-35ba2be20a1c'} Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:36:47.499031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.500214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.501454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Returning 404 to user: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:36:47.501454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4b9c40c3-484b-473f-8ba4-293fd71df124 tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "DELETE /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 404 len: 111 microversion: 2.1 time: 0.029620 Jun 24 10:36:47.501454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 89/183] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:36:47 2022] DELETE /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:47.507473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:47.508084 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] [instance: abab2387-4b51-43c6-a5dd-35ba2be20a1c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:47.516117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.516559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.517351 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:47.517782 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:47.532198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] HTTP exception thrown: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Request method failure captured: Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c HTTP/1.1 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN0kJztO2AVMzC0obnKbRQfKa-tFUaHEpSSiE9pcu5U0EWH9lBJ9DQ6ZWZ-bp-_apnnn5arKqzc1dea5DNXFSabOuceObGk92mDo-GYk2Tf71XpoO0sUYDiUipZiEhwv-PIWRPcfgET3Yk2QK49db2GJLo1Bh6ezuDH2SnrX_mTvf0 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:36:47.534504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_dee3d0adc7084828b9ed954edee54f6a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/dee3d0adc7084828b9ed954edee54f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: dee3d0adc7084828b9ed954edee54f6a Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-DeleteServersTestJSON-1710025898 Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 16daeab4accb4eeca4100b55dc9bcaa2 Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-DeleteServersTestJSON-1710025898-project Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.535959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'abab2387-4b51-43c6-a5dd-35ba2be20a1c'} Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:36:47.537043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. Jun 24 10:36:47.538296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:36:47.539405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] Returning 404 to user: Instance abab2387-4b51-43c6-a5dd-35ba2be20a1c could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:36:47.539405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a75c06ba-e1e4-4a25-a7ca-8f2c64cb074c tempest-DeleteServersTestJSON-1710025898 tempest-DeleteServersTestJSON-1710025898-project] 10.222.0.69 "GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c" status: 404 len: 111 microversion: 2.1 time: 0.032854 Jun 24 10:36:47.539405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 95/184] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:47 2022] GET /compute/v2.1/servers/abab2387-4b51-43c6-a5dd-35ba2be20a1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:36:48.259333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:48.259942 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:48.264637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:48.265434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:48.268576 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:48.269412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:48.270691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:48.271265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:48.273726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:48.274281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:48.275254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:48.275254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:48.591291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:48.595700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:48.600266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cd9ec4f0-9214-421b-a86a-0abab001504d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.341559 Jun 24 10:36:48.600847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 96/185] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:48 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:48.604356 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f9c38d6a-d0f4-41d0-b41f-dba80a502e6e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.349292 Jun 24 10:36:48.605209 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 90/186] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:48 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:49.620940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:49.621564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:49.622610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:49.624477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:49.630454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:49.632500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:49.633422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:49.633860 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:49.635554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:49.636061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:49.637459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:49.637906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:50.230219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:50.239185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d9ca247c-9d92-4d4a-8914-fd8bff365749 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.625417 Jun 24 10:36:50.240105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 97/187] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:49 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:50.241727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:50.247937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-534a0d27-28b1-4599-ba27-ee83d7f06da7 req-0f1db898-4e59-46d2-98dc-418972bf978f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe95bec9-042b-4a7c-872a-9b6aba0097d8", "name": "network-vif-plugged", "status": "completed", "tag": "79386655-e33a-42ef-9559-01bb458133a7"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:50.252106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-bb41bc3f-1e19-4af6-b04c-b021e68e3839 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.634847 Jun 24 10:36:50.255002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 91/188] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:49 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:50.256670 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-534a0d27-28b1-4599-ba27-ee83d7f06da7 req-0f1db898-4e59-46d2-98dc-418972bf978f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:50.257256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-534a0d27-28b1-4599-ba27-ee83d7f06da7 req-0f1db898-4e59-46d2-98dc-418972bf978f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:50.272884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-534a0d27-28b1-4599-ba27-ee83d7f06da7 req-0f1db898-4e59-46d2-98dc-418972bf978f service nova] Creating event network-vif-plugged:79386655-e33a-42ef-9559-01bb458133a7 for instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 on hv-cinder-84753 Jun 24 10:36:50.279370 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-534a0d27-28b1-4599-ba27-ee83d7f06da7 req-0f1db898-4e59-46d2-98dc-418972bf978f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Jun 24 10:36:50.280482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 98/189] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:51.257498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:51.258106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:51.271907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:51.273946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:51.288847 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:51.289784 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:51.292180 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:51.293497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:51.294834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:51.295499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:51.297881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:51.300342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:51.592281 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:51.604774 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d4816b03-ada1-4d8e-a883-bd6009726c90 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.352318 Jun 24 10:36:51.605661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 92/190] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:51 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:51.649680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:51.657862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a85e6e6f-26e7-4d99-a9fd-fcf25f8fcd56 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1314 microversion: 2.1 time: 0.390849 Jun 24 10:36:51.667835 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 99/191] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:51 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:52.622808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:52.623537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:52.630540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:52.630989 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:52.631895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:52.632184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:52.674684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:52.676144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:52.683163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:52.683604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:52.684371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:52.684829 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:52.835799 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:52.846742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3753ecd2-aff0-46e9-86d4-697edc431115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.227805 Jun 24 10:36:52.847325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 93/192] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:52 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:52.862583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:52.870138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1133e56c-a96c-49bf-8357-daf75dc427f7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1497 microversion: 2.1 time: 0.199355 Jun 24 10:36:52.870698 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 100/193] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:52 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:53.354436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:53.354937 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:53.361388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.361838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:53.362598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.363031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:53.394782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:36:53.493794 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8494fd3b-fc84-4e98-a7cf-c562d3d4c894 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 204 len: 0 microversion: 2.1 time: 0.143045 Jun 24 10:36:53.494795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 94/194] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:36:53 2022] DELETE /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:36:53.503556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:53.504377 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:53.510974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.511415 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:53.512168 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.512780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:53.649654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:53.659404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f540c231-180e-4177-81cc-2d6639798c19 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1503 microversion: 2.1 time: 0.160031 Jun 24 10:36:53.660017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 101/195] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:53 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:53.866420 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:53.867181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:53.874032 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.875186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:53.876623 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:53.877236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:54.016109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:54.026673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-30bf8e63-1b07-452e-91b9-d1e1e3ca4893 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.166125 Jun 24 10:36:54.027740 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 95/196] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:53 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:54.678039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:54.678629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:54.685231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:54.685685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:54.686411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:54.686836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:54.866087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:54.874872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-414e8cd8-c1bb-409d-a98a-68858e9d0c2c tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1503 microversion: 2.1 time: 0.201186 Jun 24 10:36:54.875725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 102/197] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:54 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:55.044075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:55.044720 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:55.053132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:55.053552 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:55.054314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:55.054778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:55.210653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:55.218825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-31a859f6-1a27-4bda-aee8-78eeca3df75b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.178711 Jun 24 10:36:55.219402 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 96/198] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:55 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:55.891852 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:55.892488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:55.899270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:55.899714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:55.900465 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:55.901084 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:56.041574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:56.049039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-174536d7-b1aa-4c75-b5c5-473be6341a95 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1503 microversion: 2.1 time: 0.161314 Jun 24 10:36:56.049613 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 103/199] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:55 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:56.237842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:56.238403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:56.244958 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:56.247343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:56.247583 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:56.248044 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:56.384390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:56.392361 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d8c25be5-eed5-4bfd-bfe1-89197387775d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.159273 Jun 24 10:36:56.393028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 97/200] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:56 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:57.068546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:57.069185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:57.076126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:57.076571 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:57.077360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:57.077787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:57.355264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:57.362816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1def8325-534f-44cf-a775-d580d53369c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1503 microversion: 2.1 time: 0.299856 Jun 24 10:36:57.363380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 104/201] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:57 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:57.410106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:57.410790 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:57.417007 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:57.417446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:57.418198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:57.418616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:57.578880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:57.589898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ee13ee6e-97e0-4aa4-a6f2-97d20564eb4f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.183589 Jun 24 10:36:57.590933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 98/202] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:57 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:58.175453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-8c391ce6-949d-4f83-be9e-16b1e1299bdd req-900fc2c6-ce82-4304-a785-b0699a3595a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe95bec9-042b-4a7c-872a-9b6aba0097d8", "name": "network-vif-deleted", "tag": "79386655-e33a-42ef-9559-01bb458133a7"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:58.184658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8c391ce6-949d-4f83-be9e-16b1e1299bdd req-900fc2c6-ce82-4304-a785-b0699a3595a0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.185198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8c391ce6-949d-4f83-be9e-16b1e1299bdd req-900fc2c6-ce82-4304-a785-b0699a3595a0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.197099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-8c391ce6-949d-4f83-be9e-16b1e1299bdd req-900fc2c6-ce82-4304-a785-b0699a3595a0 service nova] Creating event network-vif-deleted:79386655-e33a-42ef-9559-01bb458133a7 for instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 on hv-cinder-84753 Jun 24 10:36:58.205628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-8c391ce6-949d-4f83-be9e-16b1e1299bdd req-900fc2c6-ce82-4304-a785-b0699a3595a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034008 Jun 24 10:36:58.206836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 105/203] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:36:58.379364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:58.380005 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:58.386193 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.386633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.387688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.388145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.418315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.418961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.419186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lazy-loading 'fault' on Instance uuid fe95bec9-042b-4a7c-872a-9b6aba0097d8 {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:36:58.464574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:58.472645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-715c9951-a09e-47d1-ad2c-66d751f6b9b4 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 200 len: 1304 microversion: 2.1 time: 0.097101 Jun 24 10:36:58.473263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 99/204] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:58 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:36:58.616922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:58.617979 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:58.632962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.633405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.634178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:58.634603 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:58.809317 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:36:58.817062 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b0ae2afa-1494-4d83-bd9b-c0a9b50be9bf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.213349 Jun 24 10:36:58.817626 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 106/205] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:58 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:36:59.490216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:59.490880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: fe95bec9-042b-4a7c-872a-9b6aba0097d8] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:59.497848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:59.498293 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:59.499050 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:59.499474 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:59.513464 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] HTTP exception thrown: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Request method failure captured: Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 HTTP/1.1 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZOr-53K67m-Hyu7OgvmsmfAdHbL7TZLBCrS_Ccpqt9weZnycLpBfUC6q9dg7qrsYUW4YrOMYM0Cu9q0vhqch-ky6ophKegdqpf1CJ6goX4c5vZV3_mMceROSbHlHb8AHU1jVr-w4FnEs1UdqrKYMiuSyeeE5ZakqBpcT9d3omsfpCc Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9513ee5af8e84d48a7f28b4c77db2dd0 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesActionsTest-1520533584 Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:36:59.515078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9513ee5af8e84d48a7f28b4c77db2dd0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesActionsTest-1520533584 Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9513ee5af8e84d48a7f28b4c77db2dd0 Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesActionsTest-1520533584 Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesActionsTest-1520533584-project Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 57e63c7198d2450698858f9b84393c43 Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesActionsTest-1520533584-project Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. Jun 24 10:36:59.516545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'fe95bec9-042b-4a7c-872a-9b6aba0097d8'} Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:36:59.517521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. Jun 24 10:36:59.519436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:36:59.520839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Returning 404 to user: Instance fe95bec9-042b-4a7c-872a-9b6aba0097d8 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:36:59.520839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8274ab8f-b000-44b7-97ba-268fd707d7c1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8" status: 404 len: 111 microversion: 2.1 time: 0.030247 Jun 24 10:36:59.520839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 100/206] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:59 2022] GET /compute/v2.1/servers/fe95bec9-042b-4a7c-872a-9b6aba0097d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:59.619849 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1819687495", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "networks": [{"uuid": "8892b172-ff9b-4970-9912-4cf3bdf6c7ce"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:36:59.674765 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] validate_networks() for [('8892b172-ff9b-4970-9912-4cf3bdf6c7ce', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:36:59.834696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:36:59.835670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:36:59.842547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:59.842994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:36:59.843820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:36:59.844251 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:00.051798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:00.063815 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0f1b7c94-0c00-4df7-8a4a-ee292e040aa5 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.233625 Jun 24 10:37:00.064953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 101/207] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:36:59 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:00.102251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:37:00.102657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:37:00.103121 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:37:00.103522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:37:00.103925 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:37:00.114167 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:00.114606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:00.115445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:00.115879 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:00.134399 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Getting quotas for project 9513ee5af8e84d48a7f28b4c77db2dd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:37:00.138637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Getting quotas for user 57e63c7198d2450698858f9b84393c43 and project 9513ee5af8e84d48a7f28b4c77db2dd0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:37:00.149831 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:37:00.152085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:37:00.200709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4fe378ff-6371-42bf-8f84-d4b922c99781 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585354 Jun 24 10:37:00.206199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 107/208] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:36:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:37:00.212704 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-76df364b-0d22-493a-9345-ce757c1db0c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:00.213562 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-76df364b-0d22-493a-9345-ce757c1db0c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:00.268570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-76df364b-0d22-493a-9345-ce757c1db0c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:00.278518 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-76df364b-0d22-493a-9345-ce757c1db0c7 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1214 microversion: 2.1 time: 0.070346 Jun 24 10:37:00.279646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 102/209] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:00 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:01.081652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:01.082249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:01.089376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:01.089822 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:01.090929 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:01.091381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:01.223676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:01.231736 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-658d7952-415a-49f3-b811-142180834f22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.154541 Jun 24 10:37:01.232429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 108/210] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:01 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:01.296135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:01.297707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:01.303534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:01.304125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:01.304933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:01.305292 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:01.374589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:01.382676 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-fe352696-7838-458a-a969-3cfbd83054f3 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1210 microversion: 2.1 time: 0.090316 Jun 24 10:37:01.383577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 103/211] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:01 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:02.250047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:02.250662 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:02.257544 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:02.257946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:02.258736 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:02.259144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:02.274711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=100 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:02.390708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:02.398824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5cbdf1aa-1151-4a2f-9821-969c6f8057a8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.152979 Jun 24 10:37:02.399530 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 109/212] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:02 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:02.402108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:02.402720 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:02.408944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:02.409413 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:02.410167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:02.410592 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:02.478320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:02.487184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8af7aa02-eaa3-4ae6-9497-f8575ae6ffa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1210 microversion: 2.1 time: 0.090546 Jun 24 10:37:02.487184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 104/213] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:02 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:03.415638 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:03.416237 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:03.418793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:03.424253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:03.424628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:03.425419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:03.425832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:03.503015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:03.503638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:03.511442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:03.512256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:03.513254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:03.513690 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:03.530778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:03.597405 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:03.606552 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-27fd2d8f-8e07-4274-befd-418c90f9c2ae tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1266 microversion: 2.1 time: 0.107389 Jun 24 10:37:03.607273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 105/214] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:03 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:03.626565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:03.634195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-aa06d2f4-12c2-4514-9e3e-3a3f626f6c2f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.222525 Jun 24 10:37:03.634737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 110/215] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:03 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:04.624021 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:04.624689 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:04.626734 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:04.632351 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:04.632960 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:04.633809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:04.635036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:04.651566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:04.652939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:04.660401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:04.661256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:04.662728 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:04.663222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:04.923979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:04.930832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:04.933885 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2a6399b8-7424-408b-b011-eca27e715cee tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.313732 Jun 24 10:37:04.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 106/216] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:04 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:04.940205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-896fb163-36fd-42c6-91c1-5d600872d79c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.293234 Jun 24 10:37:04.940797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 111/217] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:04 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:05.184084 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1210482693", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:05.243858 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] validate_networks() for None {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:37:05.641462 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:37:05.642491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:37:05.643138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:37:05.643700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:37:05.644390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:37:05.655437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.656073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.656911 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.657293 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.674934 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Getting quotas for project ac68515ea7c64764b0c9f4005158e360. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:37:05.679544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Getting quotas for user 57cee90ceb214b68b07ef3f8ff0b02db and project ac68515ea7c64764b0c9f4005158e360. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:37:05.691327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:37:05.693767 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:37:05.743165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2b9ecf12-6413-4761-a365-6853a4b67a2f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563198 Jun 24 10:37:05.743762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-b07bc648-ade6-4289-87b0-e0d1c373ecc0 req-c7a3de9d-78fb-411f-b3b2-6fd331597fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4755adb9-050a-4f50-be27-f39d01a979d6", "tag": "1903e74e-2ba0-42c3-89ac-699858ec4904"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:05.751030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 107/218] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:37:05.757596 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b07bc648-ade6-4289-87b0-e0d1c373ecc0 req-c7a3de9d-78fb-411f-b3b2-6fd331597fe7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.758034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b07bc648-ade6-4289-87b0-e0d1c373ecc0 req-c7a3de9d-78fb-411f-b3b2-6fd331597fe7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.758231 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9ee02c58-74dc-4bf5-a73a-5fb8dc1d068b tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:05.759104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9ee02c58-74dc-4bf5-a73a-5fb8dc1d068b tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:05.782685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-b07bc648-ade6-4289-87b0-e0d1c373ecc0 req-c7a3de9d-78fb-411f-b3b2-6fd331597fe7 service nova] Creating event network-changed:1903e74e-2ba0-42c3-89ac-699858ec4904 for instance 4755adb9-050a-4f50-be27-f39d01a979d6 on hv-cinder-84753 Jun 24 10:37:05.788628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-b07bc648-ade6-4289-87b0-e0d1c373ecc0 req-c7a3de9d-78fb-411f-b3b2-6fd331597fe7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049944 Jun 24 10:37:05.789595 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 112/219] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:05.860154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9ee02c58-74dc-4bf5-a73a-5fb8dc1d068b tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:05.869493 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9ee02c58-74dc-4bf5-a73a-5fb8dc1d068b tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1215 microversion: 2.1 time: 0.116939 Jun 24 10:37:05.870785 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 108/220] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:05 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:05.952806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:05.954361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:05.957571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:05.958488 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:05.962508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.966667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.967706 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.968344 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.974870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.975404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:05.976345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:05.976805 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:06.288997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:06.293324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:06.300253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5872aef5-b5cc-4b99-896b-ba957aa1ec35 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.346851 Jun 24 10:37:06.302652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-45ea0af1-a490-4917-a73d-6373d964bfa6 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.354448 Jun 24 10:37:06.311052 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 109/221] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:05 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:06.314086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 113/222] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:05 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:06.887822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:06.888456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:06.895076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:06.895547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:06.896295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:06.896725 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:06.957232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:06.965718 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c09cd4dd-f8b0-465a-a03d-4dc866b24932 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1267 microversion: 2.1 time: 0.081874 Jun 24 10:37:06.966344 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 110/223] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:06 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:07.323419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:07.324161 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:07.330843 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:07.331076 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:07.331685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:07.331793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:07.332532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:07.332995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:07.338547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:07.339018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:07.339884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:07.340848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:07.576704 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:07.581101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:07.586053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-45596b03-8dfb-462d-8013-7be4d738ee70 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.259466 Jun 24 10:37:07.587199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 111/224] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:07 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:07.589880 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1e0c2ab2-d285-4dcb-92f6-f1c321369710 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.270449 Jun 24 10:37:07.590994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 114/225] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:07 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:07.988419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:07.989071 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:08.004033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.005814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:08.010512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.015258 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:08.156851 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:08.165964 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-94034c24-e653-4c08-b97f-d525ed9f0a17 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1273 microversion: 2.1 time: 0.185727 Jun 24 10:37:08.167147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 112/226] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:07 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:08.606465 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:08.607385 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:08.608191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:08.608974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:08.623732 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.624154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.624973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:08.625659 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:08.625917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.626429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:08.627302 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:08.629674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:09.132877 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:09.135482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:09.142706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-64050329-07d9-4ccd-9f5c-4c9800df839e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.538553 Jun 24 10:37:09.145529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f26aac90-1803-4d8d-8805-1ad565804ac1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.545243 Jun 24 10:37:09.146848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 115/227] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:08 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:09.153112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 113/228] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:08 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:09.184410 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:09.185049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:09.193981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:09.194564 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:09.195695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:09.196657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:09.266577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:09.279872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-48a0b268-d787-4063-95c6-b90988c479f1 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1273 microversion: 2.1 time: 0.101132 Jun 24 10:37:09.280471 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 116/229] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:09 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:09.969423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-afa14e71-662a-4f10-aef4-5fdbf70c2810 req-c7dc2434-548d-4094-8751-4163f3b095f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4755adb9-050a-4f50-be27-f39d01a979d6", "name": "network-vif-plugged", "status": "completed", "tag": "1903e74e-2ba0-42c3-89ac-699858ec4904"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:09.979486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-afa14e71-662a-4f10-aef4-5fdbf70c2810 req-c7dc2434-548d-4094-8751-4163f3b095f9 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:09.980100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-afa14e71-662a-4f10-aef4-5fdbf70c2810 req-c7dc2434-548d-4094-8751-4163f3b095f9 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.009356 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-afa14e71-662a-4f10-aef4-5fdbf70c2810 req-c7dc2434-548d-4094-8751-4163f3b095f9 service nova] Creating event network-vif-plugged:1903e74e-2ba0-42c3-89ac-699858ec4904 for instance 4755adb9-050a-4f50-be27-f39d01a979d6 on hv-cinder-84753 Jun 24 10:37:10.015283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-afa14e71-662a-4f10-aef4-5fdbf70c2810 req-c7dc2434-548d-4094-8751-4163f3b095f9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050118 Jun 24 10:37:10.016480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 114/230] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:10.167080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:10.168421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:10.168806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:10.169993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:10.175395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:10.177630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:10.187058 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.188966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.189724 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.190658 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.191256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.191845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.196336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.197475 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.572935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:10.578903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:10.587830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-963e1bec-3bb5-4276-9bc8-46b55804dbf8 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.428089 Jun 24 10:37:10.588256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5baaee83-34d1-4959-9b4b-9f11af863abc tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1522 microversion: 2.1 time: 0.427285 Jun 24 10:37:10.588724 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 115/231] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:10 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:10.599594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 117/232] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:10 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:10.602547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:10.603169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:10.609954 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.610854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.612273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.613053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.613964 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-47b84cdf-fbe8-4abc-9041-3805b01acc60 req-7efa7581-8c87-44ab-a1bb-d1e861ce3ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17de7a5-4246-411f-94ca-b7b61ec88925", "tag": "8a9387dd-35fd-471b-a976-cdbc48771ac4"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:10.633036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-47b84cdf-fbe8-4abc-9041-3805b01acc60 req-7efa7581-8c87-44ab-a1bb-d1e861ce3ffe service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:10.634023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-47b84cdf-fbe8-4abc-9041-3805b01acc60 req-7efa7581-8c87-44ab-a1bb-d1e861ce3ffe service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:10.668434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-47b84cdf-fbe8-4abc-9041-3805b01acc60 req-7efa7581-8c87-44ab-a1bb-d1e861ce3ffe service nova] Creating event network-changed:8a9387dd-35fd-471b-a976-cdbc48771ac4 for instance a17de7a5-4246-411f-94ca-b7b61ec88925 on hv-cinder-84753 Jun 24 10:37:10.688942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-47b84cdf-fbe8-4abc-9041-3805b01acc60 req-7efa7581-8c87-44ab-a1bb-d1e861ce3ffe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086711 Jun 24 10:37:10.689498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 118/233] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:10.858004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:10.869061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-896ec5af-4fa5-4a1a-848b-eb9f08115cc7 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.275785 Jun 24 10:37:10.869061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 116/234] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:10 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:11.607382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:11.608144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:11.609970 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:11.611229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:11.615298 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.615737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.616515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.616984 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.617574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.618350 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.619221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.619638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.831820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:11.840192 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4787ad59-230f-43ce-8ae8-b7e8321dcc93 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1502 microversion: 2.1 time: 0.237956 Jun 24 10:37:11.841776 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 117/235] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:11 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:11.842843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:11.850575 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0e8ff942-97ec-471d-8e9a-7528e86c312d tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.248360 Jun 24 10:37:11.851151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 119/236] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:11 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:11.857209 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:11.857861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:11.863920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.864346 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.865292 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.866415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.882290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:11.883139 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:11.889505 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.890025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:11.890779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:11.891203 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:12.127979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:12.135882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3f7f9c5e-aba5-4f2f-b669-19fe79c90fcf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1515 microversion: 2.1 time: 0.282637 Jun 24 10:37:12.137056 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 118/237] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:11 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1515 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:12.139480 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:12.148492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a4d4f906-7475-4608-9b0b-23f61dee45be tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.269130 Jun 24 10:37:12.150019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:11 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:12.867889 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:12.868753 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:12.884142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:12.884631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:12.885756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:12.886299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.031840 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:13.039581 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-202729e4-1f91-4851-9d01-d263370647ef tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1314 microversion: 2.1 time: 0.175884 Jun 24 10:37:13.040162 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 119/239] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:12 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:13.166342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:13.167070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:13.174442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.174898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.175637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.176112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.313413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:13.325317 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bc20e220-a88d-441b-a9d9-61dbeb444f13 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.162794 Jun 24 10:37:13.326109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 121/240] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:13 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:13.538325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:13.539376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:13.545599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.546231 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.546988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.547421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.571337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lazy-loading 'flavor' on Instance uuid 21e01d68-1575-4d74-8a50-e28d234be279 {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:37:13.690561 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6b0fb9b6-b006-4c92-a39a-d074ffe67ed7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/action" status: 200 len: 32 microversion: 2.1 time: 0.156193 Jun 24 10:37:13.695216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 120/241] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:37:13 2022] POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:37:13.700492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:13.701126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:13.707455 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.707949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.708729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:13.709173 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:13.849217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:13.857356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-998eddfa-c2ad-468b-bbc1-dc4515bfe90e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.160776 Jun 24 10:37:13.857976 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 122/242] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:13 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:14.058287 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:14.059125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:14.065562 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.066002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.066960 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.067394 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.258914 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:14.267227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f79febef-8961-43c0-98be-c658250c2ed9 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1497 microversion: 2.1 time: 0.213926 Jun 24 10:37:14.267864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 121/243] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:14 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:14.343306 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:14.343916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:14.350905 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.351701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.352680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.353309 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.584785 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:14.595405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1ed9e2b6-1b0d-4946-a6b1-c11f98d1361d tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.257036 Jun 24 10:37:14.596565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 123/244] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:14 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:14.877022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:14.881073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:14.881532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:14.881984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:14.892212 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.895647 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.896119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.897430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.897857 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.900441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.901453 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:14.901901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:14.918092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:14.933323 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:37:15.038307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-47cfc691-3188-45e2-95b4-18c9198fc76e tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 204 len: 0 microversion: 2.1 time: 0.163326 Jun 24 10:37:15.038978 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 124/245] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:37:14 2022] DELETE /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:37:15.047906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:15.048596 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:15.054376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:15.056451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:15.057135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:15.058797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:15.059328 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:15.063035 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-08627657-8c80-4d87-a79b-cd72db29dc2c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.192425 Jun 24 10:37:15.073716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 122/246] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:14 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:15.206896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:15.209248 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:15.215899 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7c4cadab-20b5-47ac-96db-a82c285fda89 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1503 microversion: 2.1 time: 0.172019 Jun 24 10:37:15.216478 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 125/247] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:15 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:15.613297 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:15.614042 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:15.620217 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:15.620658 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:15.621445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:15.621869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:15.665138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:15.772018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:15.779744 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-10a11cb4-e14b-4189-9c0a-d5ea573c238f tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.170091 Jun 24 10:37:15.781255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 123/248] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:15 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:15.970319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-67418807-4061-4f15-b4a2-bee20cc85fbe req-13d186bc-46cd-4760-b8f8-32f799219edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17de7a5-4246-411f-94ca-b7b61ec88925", "name": "network-vif-plugged", "status": "completed", "tag": "8a9387dd-35fd-471b-a976-cdbc48771ac4"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:15.983538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-67418807-4061-4f15-b4a2-bee20cc85fbe req-13d186bc-46cd-4760-b8f8-32f799219edd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:15.984155 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-67418807-4061-4f15-b4a2-bee20cc85fbe req-13d186bc-46cd-4760-b8f8-32f799219edd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:15.996360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-67418807-4061-4f15-b4a2-bee20cc85fbe req-13d186bc-46cd-4760-b8f8-32f799219edd service nova] Creating event network-vif-plugged:8a9387dd-35fd-471b-a976-cdbc48771ac4 for instance a17de7a5-4246-411f-94ca-b7b61ec88925 on hv-cinder-84753 Jun 24 10:37:16.002245 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-67418807-4061-4f15-b4a2-bee20cc85fbe req-13d186bc-46cd-4760-b8f8-32f799219edd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Jun 24 10:37:16.003075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 126/249] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:16.082256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:16.083487 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:16.091109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=10 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:16.094311 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.095013 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.096159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.096726 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.234848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:16.235676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:16.243028 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.243737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.244664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.245290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.262204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:16.271782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-13c6cbbe-7eaf-4df8-8982-4cb3ac6692cf tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.192860 Jun 24 10:37:16.273536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 124/250] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:16 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:16.426391 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:16.434615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0f10aa7f-0b5e-4645-bc53-1617ac14d0a1 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1503 microversion: 2.1 time: 0.204329 Jun 24 10:37:16.435196 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 127/251] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:16 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:16.798132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:16.798657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:16.804832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.805276 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.806021 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:16.806502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:16.942195 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:16.953931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-151eddb1-3590-4d46-9901-88396d297caf tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.159724 Jun 24 10:37:16.963213 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 125/252] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:16 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:17.289828 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:17.290791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:17.292881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-c2f59a13-c6ad-4e8b-b63c-6da771e4eba8 req-09a4d5fe-659e-446e-acdc-17779f487a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4755adb9-050a-4f50-be27-f39d01a979d6", "name": "network-vif-deleted", "tag": "1903e74e-2ba0-42c3-89ac-699858ec4904"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:17.299481 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.300341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.301007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.301577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.303279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c2f59a13-c6ad-4e8b-b63c-6da771e4eba8 req-09a4d5fe-659e-446e-acdc-17779f487a37 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.303921 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c2f59a13-c6ad-4e8b-b63c-6da771e4eba8 req-09a4d5fe-659e-446e-acdc-17779f487a37 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.315742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-c2f59a13-c6ad-4e8b-b63c-6da771e4eba8 req-09a4d5fe-659e-446e-acdc-17779f487a37 service nova] Creating event network-vif-deleted:1903e74e-2ba0-42c3-89ac-699858ec4904 for instance 4755adb9-050a-4f50-be27-f39d01a979d6 on hv-cinder-84753 Jun 24 10:37:17.322413 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-c2f59a13-c6ad-4e8b-b63c-6da771e4eba8 req-09a4d5fe-659e-446e-acdc-17779f487a37 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Jun 24 10:37:17.323519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 126/253] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:37:17.448392 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:17.456569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d2f581bd-4c01-4b3d-8021-83d6c5b247f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.170870 Jun 24 10:37:17.459447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 128/254] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:17 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:17.459689 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:17.460398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:17.472510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.473637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.474941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.475515 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.554153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:17.561946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-17d29c8a-2840-427c-af25-c3a8460a7009 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1461 microversion: 2.1 time: 0.114065 Jun 24 10:37:17.563511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 127/255] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:17 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:17.971842 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:17.972458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:17.979863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.980314 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:17.981128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:17.981558 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.246174 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:18.254789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bb6b2752-efd9-4e54-9229-ca3bcb4001b2 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1315 microversion: 2.1 time: 0.287158 Jun 24 10:37:18.255646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 129/256] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:17 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:18.478285 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:18.480700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:18.490388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:18.497268 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.498376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:18.500318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.583704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:18.584863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:18.594933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:18.599247 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.600269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:18.607347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.666111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:18.666745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:18.667204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lazy-loading 'fault' on Instance uuid 4755adb9-050a-4f50-be27-f39d01a979d6 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:37:18.721567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:18.731890 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a66a1eda-ed20-4038-8ae4-2b5475b08f37 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.261200 Jun 24 10:37:18.737688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 128/257] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:18 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:18.738031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e63c7198d2450698858f9b84393c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513ee5af8e84d48a7f28b4c77db2dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:18.744911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-dabe2530-d38b-4310-880f-a3c6c0d60882 tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 200 len: 1304 microversion: 2.1 time: 0.167335 Jun 24 10:37:18.745481 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 130/258] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:18 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:19.272499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:19.273357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:19.282463 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.283003 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.284336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.284933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.490376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:19.500038 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b4c4647a-0ae6-45ab-9c6d-66248091fb01 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1465 microversion: 2.1 time: 0.231336 Jun 24 10:37:19.500633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 129/259] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:19 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1465 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:19.552406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:19.552924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:19.562381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.563695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.564992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.565528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.599460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:37:19.707977 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-feadc4e4-5d6d-4ead-b066-701211e0cd86 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 204 len: 0 microversion: 2.1 time: 0.159189 Jun 24 10:37:19.709023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 131/260] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:37:19 2022] DELETE /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:37:19.717943 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:19.718572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:19.725194 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.725947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.726773 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.727358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.750705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:19.751710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:19.765993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.769210 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.770500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:19.773137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:19.974677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:19.986973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7af3b019-e9f2-4461-8ce2-55209107a2ec tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1471 microversion: 2.1 time: 0.272743 Jun 24 10:37:19.988667 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 130/261] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:19 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:19.996669 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:19.997738 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] [instance: 4755adb9-050a-4f50-be27-f39d01a979d6] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:20.008121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:20.008688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:20.009611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:20.011536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:20.056009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:20.079103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bc34ba63-ba2a-4232-8be7-ba4fff37d555 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.332786 Jun 24 10:37:20.090464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 132/262] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:19 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:20.201420 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] HTTP exception thrown: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Request method failure captured: Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 HTTP/1.1 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZOr-53K67m-Hyu7OgvmsmfAdHbL7TZLBCrS_Ccpqt9weZnycLpBfUC6q9dg7qrsYUW4YrOMYM0Cu9q0vhqch-ky6ophKegdqpf1CJ6goX4c5vZV3_mMceROSbHlHb8AHU1jVr-w4FnEs1UdqrKYMiuSyeeE5ZakqBpcT9d3omsfpCc Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9513ee5af8e84d48a7f28b4c77db2dd0 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesActionsTest-1520533584 Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:37:20.203129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9513ee5af8e84d48a7f28b4c77db2dd0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9513ee5af8e84d48a7f28b4c77db2dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesActionsTest-1520533584 Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9513ee5af8e84d48a7f28b4c77db2dd0 Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesActionsTest-1520533584 Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesActionsTest-1520533584-project Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 57e63c7198d2450698858f9b84393c43 Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesActionsTest-1520533584-project Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. Jun 24 10:37:20.204509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '4755adb9-050a-4f50-be27-f39d01a979d6'} Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:37:20.205269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. Jun 24 10:37:20.206372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:20.207327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] Returning 404 to user: Instance 4755adb9-050a-4f50-be27-f39d01a979d6 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:37:20.207327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a8d89893-76db-4569-9b45-6c4bf3321d3f tempest-VolumesActionsTest-1520533584 tempest-VolumesActionsTest-1520533584-project] 10.222.0.69 "GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6" status: 404 len: 111 microversion: 2.1 time: 0.214579 Jun 24 10:37:20.207327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 131/263] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:19 2022] GET /compute/v2.1/servers/4755adb9-050a-4f50-be27-f39d01a979d6 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:37:21.006545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:21.007263 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:21.014686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:21.015203 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:21.016032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:21.016530 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:21.102995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:21.103718 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:21.109984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:21.110418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:21.111174 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:21.111598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:21.161202 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:21.169528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5382b8e5-4195-4fa6-bfb8-a88b98561fdb tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1471 microversion: 2.1 time: 0.166761 Jun 24 10:37:21.178962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 133/264] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:21 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:21.243772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:21.255629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-394ce3cb-08b3-4905-93c5-01a686a5932b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.156337 Jun 24 10:37:21.256394 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 132/265] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:21 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:22.187866 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:22.188499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:22.195606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.196066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.196954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.197404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.274810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:22.276148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:22.283070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.283548 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.284309 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.284757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.360019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:22.368922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e906e543-1835-41ac-af1f-cfa8fab7f508 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1471 microversion: 2.1 time: 0.185401 Jun 24 10:37:22.369517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 134/266] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:22 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:22.403757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:22.404242 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:22.410653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.411370 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.412130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:22.412586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:22.426259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:22.433995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9ead5816-a79d-4620-b11c-efbd80c9f813 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.163705 Jun 24 10:37:22.434638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 133/267] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:22 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:22.437089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-db0b8990-074b-4056-b3b0-6348d60131c6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/ips" status: 200 len: 150 microversion: 2.20 time: 0.037295 Jun 24 10:37:22.443422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 135/268] 10.222.0.69 () {60 vars in 1288 bytes} [Fri Jun 24 10:37:22 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:37:23.081979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:23.082441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:23.091396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.091838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.092610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.093067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.116415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7954a112-1a46-4049-b65d-957bafd1c8a0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/ips" status: 200 len: 145 microversion: 2.1 time: 0.040360 Jun 24 10:37:23.117012 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 134/269] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:37:23 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:23.389021 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:23.389563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:23.396484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.396964 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.397724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.398156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.454816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:23.454816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:23.459972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.460497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.461364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:23.461854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:23.588890 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:23.597945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-418dcdba-f525-484b-bb55-ec92f4381e60 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1471 microversion: 2.1 time: 0.214104 Jun 24 10:37:23.598553 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 136/270] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:23 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:23.624097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:23.631809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-692873e7-0fed-4fab-bb0b-f33a045d2be8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.184189 Jun 24 10:37:23.632373 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 135/271] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:23 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:24.345365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f4f2642c-d949-415e-8f46-1d59aabbc32f req-bb78f918-732d-49e7-91e9-bed234048ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17de7a5-4246-411f-94ca-b7b61ec88925", "name": "network-vif-deleted", "tag": "8a9387dd-35fd-471b-a976-cdbc48771ac4"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:24.354473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f4f2642c-d949-415e-8f46-1d59aabbc32f req-bb78f918-732d-49e7-91e9-bed234048ed5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.355334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f4f2642c-d949-415e-8f46-1d59aabbc32f req-bb78f918-732d-49e7-91e9-bed234048ed5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.367435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f4f2642c-d949-415e-8f46-1d59aabbc32f req-bb78f918-732d-49e7-91e9-bed234048ed5 service nova] Creating event network-vif-deleted:8a9387dd-35fd-471b-a976-cdbc48771ac4 for instance a17de7a5-4246-411f-94ca-b7b61ec88925 on hv-cinder-84753 Jun 24 10:37:24.372957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f4f2642c-d949-415e-8f46-1d59aabbc32f req-bb78f918-732d-49e7-91e9-bed234048ed5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Jun 24 10:37:24.373655 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 137/272] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:24.616230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:24.616869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:24.623671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.624124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.625105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.625535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.651458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:24.652371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:24.657992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.658436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.658880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lazy-loading 'fault' on Instance uuid a17de7a5-4246-411f-94ca-b7b61ec88925 {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:37:24.659421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.659859 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.660590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:24.661047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:24.700460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cee90ceb214b68b07ef3f8ff0b02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac68515ea7c64764b0c9f4005158e360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:24.708215 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4be560d2-6ea7-4eaa-aec5-514d913787f3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 200 len: 1305 microversion: 2.1 time: 0.096236 Jun 24 10:37:24.708850 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 136/273] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:24 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:24.807087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:24.817434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-77195735-fd1e-45cd-b3d0-53ddd1316b69 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.171702 Jun 24 10:37:24.817975 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 138/274] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:24 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:25.087689 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421de70c-bcee-441b-96e6-e3004fcf09b7"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:25.088944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:25.096345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.096901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:25.097686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.098118 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:25.445364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-de7205fd-3e93-40f1-bda8-0d863af48e13 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361276 Jun 24 10:37:25.453237 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 137/275] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:37:25 2022] POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:25.725581 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:25.726181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] [instance: a17de7a5-4246-411f-94ca-b7b61ec88925] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:25.733719 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.734162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:25.734926 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.735674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:25.750487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] HTTP exception thrown: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Request method failure captured: Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 HTTP/1.1 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZPP_hFMJRAE8Ap9UsGOxtvXlygYIflztwm6pBmegzDduMAywryKxk2P5ZOo5Tfwlgb5z_zpLEKr97M7qI68TrTvj7TBeAxWhKvVzNA8eNcXUlk2bTC9oqPwTJC5ghcQKUyg3tg4I8VGHJeBgdiaPqFidmGlIn1GXjJfiIZfoYi9jAE Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: ac68515ea7c64764b0c9f4005158e360 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesNegativeTest-1981620608 Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:37:25.752153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ac68515ea7c64764b0c9f4005158e360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ac68515ea7c64764b0c9f4005158e360", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ac68515ea7c64764b0c9f4005158e360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ac68515ea7c64764b0c9f4005158e360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesNegativeTest-1981620608 Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: ac68515ea7c64764b0c9f4005158e360 Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesNegativeTest-1981620608 Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesNegativeTest-1981620608-project Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 57cee90ceb214b68b07ef3f8ff0b02db Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesNegativeTest-1981620608-project Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. Jun 24 10:37:25.753651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'a17de7a5-4246-411f-94ca-b7b61ec88925'} Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:37:25.754451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. Jun 24 10:37:25.755519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:37:25.756462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] Returning 404 to user: Instance a17de7a5-4246-411f-94ca-b7b61ec88925 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:37:25.756462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-38dd5b00-ac09-498f-9101-da9f730194d3 tempest-VolumesNegativeTest-1981620608 tempest-VolumesNegativeTest-1981620608-project] 10.222.0.69 "GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925" status: 404 len: 111 microversion: 2.1 time: 0.032203 Jun 24 10:37:25.756462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 139/276] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:25 2022] GET /compute/v2.1/servers/a17de7a5-4246-411f-94ca-b7b61ec88925 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:37:25.835485 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:25.836169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:25.843992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.844443 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:25.845256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:25.845707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:26.017875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:26.029808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-22c35ac4-7c5c-43ea-b066-bf2e61c78e81 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.198949 Jun 24 10:37:26.030719 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 138/277] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:25 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:26.135017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:26.135546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:26.142583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:26.144104 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:26.146687 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:26.147044 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:26.177367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lazy-loading 'flavor' on Instance uuid 2d906fe1-2729-458e-8564-c4ba21b2767a {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:37:26.277716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:26.647261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-24646996-7079-4421-b23a-9924f0937322 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/action" status: 202 len: 0 microversion: 2.20 time: 0.515296 Jun 24 10:37:26.649521 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 140/278] 10.222.0.69 () {62 vars in 1318 bytes} [Fri Jun 24 10:37:26 2022] POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:37:26.659470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:26.660526 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:26.669026 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:26.669644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:26.670555 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:26.671128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:26.692125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:26.836627 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:26.851908 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:26.853592 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:26.855326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a358537b-7965-4ed7-a4d0-1663c242f695 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.200356 Jun 24 10:37:26.856112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 139/279] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:26 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:27.055640 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:27.057489 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:27.066125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:27.066859 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:27.067914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:27.068414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:27.281974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:27.292998 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7f212ba1-a578-4d51-abea-5ece943af3bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.244076 Jun 24 10:37:27.295833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 141/280] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:27 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:27.875043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:27.875696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:27.886545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:27.887226 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:27.888365 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:27.889109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:28.092882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:28.102633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:28.105181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:28.106889 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ccd74d1a-acb8-4ccb-b3a1-ea3c1a2476e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.236337 Jun 24 10:37:28.107947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 140/281] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:27 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:28.318364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:28.319856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:28.334629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:28.335557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:28.337610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:28.338186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:28.579081 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:28.595439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-74c94a01-85cb-40e3-9b3e-762f8bf00b9a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.281822 Jun 24 10:37:28.596691 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 142/282] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:28 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:29.125879 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:29.126671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:29.134296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:29.134753 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:29.135533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:29.135971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:29.344536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:29.353625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:29.356253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:29.357694 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d08dc056-38a7-4d75-9df0-ff7e0698e262 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.235774 Jun 24 10:37:29.370893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 141/283] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:29 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:29.615298 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:29.615922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:29.633773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:29.635089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:29.636457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:29.637778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:29.898456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:29.914006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-483b15bc-b7f1-48d8-b8e1-1a189161afbb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.303268 Jun 24 10:37:29.914792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 143/284] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:29 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:30.381507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:30.386727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:30.400671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:30.401705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:30.403149 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:30.404230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:30.938229 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:30.940924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:30.949541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:30.956570 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:30.958070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:30.962670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:30.964306 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:30.965569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:30.967360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:30.969123 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5a55dda1-ec3d-4fe3-b976-aa401d7f5bda tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.594490 Jun 24 10:37:30.973860 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 142/285] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:30 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:31.250610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:31.265874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b038656a-abf9-4a33-95ad-6d12a804a7df tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.331117 Jun 24 10:37:31.268619 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 144/286] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:30 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:31.991552 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:31.992169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:32.006107 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:32.006537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:32.007313 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:32.007739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:32.211723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:32.222671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:32.224335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:32.225775 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-819bb28d-e37b-4645-a8d0-804a7a71f1c9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.238156 Jun 24 10:37:32.226428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 143/287] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:31 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:32.285578 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:32.286917 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:32.298276 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:32.298877 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:32.299979 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:32.300513 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:32.484137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:32.494653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-229196ea-971b-43a3-9c31-98476bb7638f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.213479 Jun 24 10:37:32.495975 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 145/288] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:32 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:33.244991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:33.245667 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:33.257267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.257905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.258876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.259456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.500140 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:33.512143 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:33.513457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:33.513838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:33.515364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:33.516806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ae648211-f385-4a26-bc0f-1d3691af03ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.276852 Jun 24 10:37:33.517050 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:33.520003 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 144/289] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:33 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:33.542519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.543267 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.544272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.545388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.750034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:33.758490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f0e0a1f0-7e85-483a-90c5-1ad90749ac96 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1501 microversion: 2.1 time: 0.250563 Jun 24 10:37:33.759103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 146/290] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:33 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:33.778096 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57fd74b1-6ecd-4285-9ddc-f204fe4977e7"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:33.780151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:33.790122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.791067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.793503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.794162 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.835485 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] HTTP exception thrown: Cannot 'attach_volume' instance 21e01d68-1575-4d74-8a50-e28d234be279 while it is in vm_state rescued Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Request method failure captured: Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/os-volume_attachments HTTP/1.1 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 74 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN-gToLcv_Sslb-xAViBn5WFYlOn0CANhAFQgPBFr4cZReX6DxYRmi1nOG8IVpkxzFjShoHKF6T5U_OTbYFRSOsV7fljzYxlSLN0CRHQglHZKz9nmBmYZqF-1kfZZL7PbZ18jFOjVaYKD7AnIvya4F7qCFsoLnPvAugqr_6vJ39pT0 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:37:33.837992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8cc166ec03349b3b2b0d69840886bd9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 960b18fe180f4185b291da1d9c18a2fa Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {"volumeAttachment": {"volumeId": "57fd74b1-6ecd-4285-9ddc-f204fe4977e7"}} Jun 24 10:37:33.839458 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Cannot 'attach_volume' instance 21e01d68-1575-4d74-8a50-e28d234be279 while it is in vm_state rescued Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'server_id': '21e01d68-1575-4d74-8a50-e28d234be279', 'body': {'volumeAttachment': {'volumeId': '57fd74b1-6ecd-4285-9ddc-f204fe4977e7'}}} Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21e01d68-1575-4d74-8a50-e28d234be279 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:37:33.840604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 21e01d68-1575-4d74-8a50-e28d234be279 while it is in vm_state rescued Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:37:33.842656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:37:33.845357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:37:33.845357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:37:33.845357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 21e01d68-1575-4d74-8a50-e28d234be279 while it is in vm_state rescued Jun 24 10:37:33.845357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:37:33.846013 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Returning 409 to user: Cannot 'attach_volume' instance 21e01d68-1575-4d74-8a50-e28d234be279 while it is in vm_state rescued {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:37:33.847216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a87d4780-b9a6-425f-ab7b-f6acb260d657 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074345 Jun 24 10:37:33.848416 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 145/291] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:37:33 2022] POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:37:33.857397 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:33.858368 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:33.864904 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.865618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.871770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:33.872450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:33.988147 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c78466dd-0fe0-4335-85d1-d9b2d264be17 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/action" status: 202 len: 0 microversion: 2.1 time: 0.134733 Jun 24 10:37:34.001172 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 147/292] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:37:33 2022] POST /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:37:34.008662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:34.009787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:34.021547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.022029 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.023579 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.024022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.332417 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:34.341268 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cfb3f28f-a53b-4670-801a-c87808b1ff8a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1509 microversion: 2.1 time: 0.335365 Jun 24 10:37:34.346431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 146/293] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:34 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:34.536057 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:34.536808 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:34.548989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.549432 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.552177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.556224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.617936 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-33da807f-d304-4a5e-8a22-76a959a7dd48 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:34.624516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:34.626742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33da807f-d304-4a5e-8a22-76a959a7dd48 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.627386 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33da807f-d304-4a5e-8a22-76a959a7dd48 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.738980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-33da807f-d304-4a5e-8a22-76a959a7dd48 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Going to try to stop instance {{(pid=124303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:37:34.827823 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-33da807f-d304-4a5e-8a22-76a959a7dd48 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action" status: 202 len: 0 microversion: 2.1 time: 0.213694 Jun 24 10:37:34.843059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 147/294] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:37:34 2022] POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:37:34.848659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:34.849377 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:34.863426 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.863896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:34.864828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:34.865246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:35.016804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:35.025826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:35.027696 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:35.029114 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fc33624e-0b1a-4ea7-8b0b-f3adc9ad6e6e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.497944 Jun 24 10:37:35.040464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 148/295] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:34 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:35.119687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:35.129241 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-caa58621-e8a1-4bda-9577-90d69ba46cbb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.284675 Jun 24 10:37:35.129818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 148/296] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:34 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:35.362788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:35.363499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:35.371941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:35.372483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:35.373507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:35.373945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:35.563978 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:35.573999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f212edb1-7e84-4a09-90cb-6f29fe228560 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1509 microversion: 2.1 time: 0.215135 Jun 24 10:37:35.575522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 149/297] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:35 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:35.976333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-396515634", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "networks": [{"uuid": "f971c2fc-6773-4a3f-b3f9-0aff8661b44d"}]}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:36.048000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:36.048854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:36.055533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.056214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.057132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.057770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.061396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] validate_networks() for [('f971c2fc-6773-4a3f-b3f9-0aff8661b44d', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:37:36.398965 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:36.419814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:36.422367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:36.423744 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a8572d00-310a-4ec4-9690-e54db090cd9a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.379960 Jun 24 10:37:36.438425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 150/298] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:36 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:36.449703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:36.450914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:36.464624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.466089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.467599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.468409 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.767029 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:37:36.768712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:36.769791 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:37:36.770480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:37:36.773225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:37:36.773798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:37:36.786601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-451d0263-bec8-47c7-89f7-11f3abdc49d6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.346595 Jun 24 10:37:36.788621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 151/299] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:36 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:36.803249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.803984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.805036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.805694 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.805825 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:36.806414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:36.813624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.814068 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.814947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:36.815747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:36.828256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Getting quotas for project b88db10e9091496a84e87446da50a3b6. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:37:36.833866 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Getting quotas for user 60367bf464f4441483bfe4a1373a1e92 and project b88db10e9091496a84e87446da50a3b6. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:37:36.856099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:37:36.858753 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:37:36.910296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5bec871c-22de-4dd1-98bb-2e891310f0da tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938007 Jun 24 10:37:36.911314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 149/300] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:37:36.922084 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6400fb4f-9a6c-4988-9e33-dc278c7caeb6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:36.923279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6400fb4f-9a6c-4988-9e33-dc278c7caeb6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:37.015238 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6400fb4f-9a6c-4988-9e33-dc278c7caeb6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:37.027259 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6400fb4f-9a6c-4988-9e33-dc278c7caeb6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1218 microversion: 2.1 time: 0.109039 Jun 24 10:37:37.031421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 150/301] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:36 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:37.101853 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:37.114282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ca46047e-cdbe-4342-a2f0-64cb10c2ce64 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1509 microversion: 2.1 time: 0.312971 Jun 24 10:37:37.115608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 152/302] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:36 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:37.445766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:37.446317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:37.475861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:37.476328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:37.484006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:37.484595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:37.707950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:37.717944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:37.719872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:37.721295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7b91d6ed-3c62-42f5-8b87-93ec2d9eed0d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.281499 Jun 24 10:37:37.722043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 151/303] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:37 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:37.806266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:37.807501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:37.814040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:37.817207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:37.820089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:37.820599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.052606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:38.053762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:38.066026 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.067456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.068497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.069595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.082281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:38.093923 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b518a7fd-8550-43a8-bd77-05d51eba269a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.291575 Jun 24 10:37:38.096367 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 153/304] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:37 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:38.144772 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:38.148250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:38.165569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.166299 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.167238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.168495 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.218512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:38.228873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f27ee66c-2e0d-48ce-8f5d-9d339830e7ba tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1270 microversion: 2.1 time: 0.182291 Jun 24 10:37:38.230045 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 152/305] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:38 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:38.548677 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:38.568179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-86dbcf2f-83ca-44f1-8ba5-7430249e3115 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1515 microversion: 2.1 time: 0.435549 Jun 24 10:37:38.568931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 154/306] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:38 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1515 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:38.741756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:38.743595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:38.756580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.757153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.759043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:38.759553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:38.987461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:39.002026 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:39.009895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:39.011999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d67d308e-c85c-41e9-b8e7-88d0805d200b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.275461 Jun 24 10:37:39.013640 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 153/307] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:38 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:39.116566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:39.118043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:39.131009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:39.132117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:39.133500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:39.134219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:39.250645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:39.252978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:39.277869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:39.282490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:39.284790 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:39.285577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:39.469665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:39.481570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cac6cef7-b7ec-4eef-9872-4d02330d6df4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1276 microversion: 2.1 time: 0.235342 Jun 24 10:37:39.483025 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 154/308] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:39 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:39.644856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:39.671082 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-18747204-239d-4c79-be1e-e1ddcbc9bb5f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.561210 Jun 24 10:37:39.695353 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 155/309] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:39 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:40.031810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:40.032534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:40.043571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.044374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.046878 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.047519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.215573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-008b7887-863e-42ca-b8e7-51785dfa5d3c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: .version_select at 0x7f17646eb310>, body: {"keypair": {"name": "tempest-keypair-2008615593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3gHl/dBlHUCxW8vcEeYzLvCsoPJ9VW3l0YmfYGuJPADfMgvMP1j6wQiSJaBUUB6OZr8XU7uKBT4drY/5fg/VEoLfnpacWQrrRjSzweb4eR0lyMDFPh3suVWaSXV8iKqA=="}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:40.262060 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-008b7887-863e-42ca-b8e7-51785dfa5d3c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:37:40.278519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-008b7887-863e-42ca-b8e7-51785dfa5d3c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for user 960b18fe180f4185b291da1d9c18a2fa and project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:37:40.329668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-008b7887-863e-42ca-b8e7-51785dfa5d3c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116584 Jun 24 10:37:40.334023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 156/310] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:37:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:40.517886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:40.521973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:40.540392 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.541164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.542272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.543039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.565620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:40.703692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:40.718893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:40.725645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:40.727210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7a2cf41d-903d-4635-80f5-7ac1a50638ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.700078 Jun 24 10:37:40.730841 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 155/311] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:40 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:40.737370 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:40.738054 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:40.746034 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.746547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.747385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:40.747881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:40.876490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:40.885867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d28afc87-300d-4773-b915-7a465eb081e7 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.374775 Jun 24 10:37:40.886460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 157/312] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:40 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:41.084532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:41.091158 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:41.105930 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3b30d93f-9398-4b30-8d92-15fea7cc8565 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.368865 Jun 24 10:37:41.108451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 156/313] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:40 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:41.390513 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-4e4fe6b7-5ee9-48e1-a0d1-5aba8ca2b2b0 req-71c87892-0848-49e0-8176-584102d816ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82903e26-c3ed-45b5-8ac6-df037373bd89", "tag": "32a01ad2-4b70-496e-b8f5-5e71cad379fc"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:41.457879 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4e4fe6b7-5ee9-48e1-a0d1-5aba8ca2b2b0 req-71c87892-0848-49e0-8176-584102d816ba service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:41.459446 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4e4fe6b7-5ee9-48e1-a0d1-5aba8ca2b2b0 req-71c87892-0848-49e0-8176-584102d816ba service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:41.490914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-4e4fe6b7-5ee9-48e1-a0d1-5aba8ca2b2b0 req-71c87892-0848-49e0-8176-584102d816ba service nova] Creating event network-changed:32a01ad2-4b70-496e-b8f5-5e71cad379fc for instance 82903e26-c3ed-45b5-8ac6-df037373bd89 on hv-cinder-84753 Jun 24 10:37:41.498108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-4e4fe6b7-5ee9-48e1-a0d1-5aba8ca2b2b0 req-71c87892-0848-49e0-8176-584102d816ba service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117413 Jun 24 10:37:41.499046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 158/314] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:41.750282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:41.750975 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:41.768574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:41.769643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:41.769907 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:41.770239 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:41.910401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:41.912217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:41.928901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:41.929702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:41.930911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:41.931585 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:42.087318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:42.096005 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:42.097775 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:42.099238 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-82434d41-923e-46e3-8ee0-2e2508d720e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.353746 Jun 24 10:37:42.110634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 157/315] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:41 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:42.125245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:42.127746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:42.135834 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:42.136692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:42.138016 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:42.138758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:42.278101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:42.286811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bae64b28-2894-48b1-b023-9f303ec7cd04 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.381709 Jun 24 10:37:42.299030 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 159/316] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:41 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:42.424818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:42.437669 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8fc44996-96d1-48ed-95ac-be154bbe08d9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.317939 Jun 24 10:37:42.438637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 158/317] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:42 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:42.841189 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1632507985", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45ee52c2-5913-4161-9d2c-193dab823ea6"}], "security_groups": [{"name": "tempest-securitygroup--1782775995"}], "key_name": "tempest-keypair-2008615593", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:42.984892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] validate_networks() for [('45ee52c2-5913-4161-9d2c-193dab823ea6', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:37:43.124596 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:43.125714 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:43.135373 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.136215 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.137327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.138290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.534959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:43.534959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:43.535494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:43.535494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-dd937c15-06ce-4998-8b5e-35ee03d78d60 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.421183 Jun 24 10:37:43.545121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 159/318] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:43 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:37:43.550240 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:43.550852 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:43.557661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.558298 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.559238 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.559836 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.750382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:37:43.751120 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:37:43.751593 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:37:43.751996 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:37:43.752413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:37:43.764595 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.765278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.766658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.766658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.788933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:37:43.802885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Getting quotas for user 960b18fe180f4185b291da1d9c18a2fa and project d8cc166ec03349b3b2b0d69840886bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:37:43.829668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:37:43.832356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:37:43.842595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:43.855130 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f7a2bfe6-4d89-47c1-b20d-24d660b1d472 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.308782 Jun 24 10:37:43.864845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 160/319] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:43 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:43.871831 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:43.872644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:43.891000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.891611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.892620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:43.893239 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:43.905010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-839fb2a2-2b41-427f-a194-df074ebdb3c0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.069863 Jun 24 10:37:43.906699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 160/320] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:37:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:37:43.916757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7292ebba-f6e8-4c22-9a21-0cc155d10284 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:43.920255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7292ebba-f6e8-4c22-9a21-0cc155d10284 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:44.005750 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7292ebba-f6e8-4c22-9a21-0cc155d10284 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:44.018041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7292ebba-f6e8-4c22-9a21-0cc155d10284 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1246 microversion: 2.1 time: 0.104829 Jun 24 10:37:44.018590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 161/321] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:43 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:44.211265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:44.241866 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2433f59c-8eea-431f-ac10-155b9731e160 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.370425 Jun 24 10:37:44.244051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 161/322] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:43 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:44.554430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:44.555284 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:44.572319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:44.572787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:44.574045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:44.574360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:44.743722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:44.753763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:44.755274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:44.756495 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3b2ce73d-aa94-43c0-9134-76ec6120504a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.207016 Jun 24 10:37:44.768010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 162/323] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:44 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:44.875554 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:44.876640 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:44.884454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:44.885209 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:44.886161 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:44.886776 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.031746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:45.034494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:45.035163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:45.039545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8fac043e-e943-4e4e-8558-2d7ebc678c05 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.171065 Jun 24 10:37:45.040115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 162/324] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:44 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:45.041703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.042138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.042969 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.043398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.108282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:45.116390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d8262216-72a5-4aad-8ca4-209a8c3c9276 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1298 microversion: 2.1 time: 0.085714 Jun 24 10:37:45.116962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 163/325] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:45 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:45.264041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:45.264614 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:45.271331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.271809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.272596 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.273061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.408644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:45.417670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2099eb45-c033-41fc-973b-e60db8db8445 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1723 microversion: 2.1 time: 0.159123 Jun 24 10:37:45.418429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 163/326] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:45 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:45.777466 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:45.778830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:45.787114 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.787791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.788919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:45.789641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:45.993898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.009810 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.011676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.013137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a68cdada-7bf5-46a0-b152-0d06e6d70d7e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.240607 Jun 24 10:37:46.013819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 164/327] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:45 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:46.056317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:46.056956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:46.068232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.068677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.069482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.069912 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.134445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:46.135818 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:46.144427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.145221 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.146393 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.147541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.501316 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.509460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e40e8c4b-d9ba-432d-89bd-61c5b82d0e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1304 microversion: 2.1 time: 0.379691 Jun 24 10:37:46.514279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 165/328] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:46 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1304 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:46.519380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:46.522938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:46.538247 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.539887 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.540825 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.542177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.654764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.663058 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4d63a487-9108-48e5-a62d-e73864d84492 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.610570 Jun 24 10:37:46.674929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 164/329] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:46 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:46.686943 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-c4d1ea95-8b4d-4fc3-8c33-0cb315fa9c77 req-d0fb7485-b43c-4a05-9367-b2fd1f2117e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82903e26-c3ed-45b5-8ac6-df037373bd89", "name": "network-vif-plugged", "status": "completed", "tag": "32a01ad2-4b70-496e-b8f5-5e71cad379fc"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:46.697910 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c4d1ea95-8b4d-4fc3-8c33-0cb315fa9c77 req-d0fb7485-b43c-4a05-9367-b2fd1f2117e7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.698534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c4d1ea95-8b4d-4fc3-8c33-0cb315fa9c77 req-d0fb7485-b43c-4a05-9367-b2fd1f2117e7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.714810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-c4d1ea95-8b4d-4fc3-8c33-0cb315fa9c77 req-d0fb7485-b43c-4a05-9367-b2fd1f2117e7 service nova] Creating event network-vif-plugged:32a01ad2-4b70-496e-b8f5-5e71cad379fc for instance 82903e26-c3ed-45b5-8ac6-df037373bd89 on hv-cinder-84753 Jun 24 10:37:46.721438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-c4d1ea95-8b4d-4fc3-8c33-0cb315fa9c77 req-d0fb7485-b43c-4a05-9367-b2fd1f2117e7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044949 Jun 24 10:37:46.722165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 165/330] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:46.825959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:46.837088 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0b2b14ee-f490-4197-90cc-cc0a6adaefe3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1700 microversion: 2.1 time: 0.321399 Jun 24 10:37:46.838271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 166/331] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:46 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1700 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:46.858491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d4e8034e-9517-40e4-a500-bbb2ab84fb28 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:46.866927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:46.874834 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4e8034e-9517-40e4-a500-bbb2ab84fb28 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:46.874834 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d4e8034e-9517-40e4-a500-bbb2ab84fb28 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:46.919421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d4e8034e-9517-40e4-a500-bbb2ab84fb28 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Going to try to start instance {{(pid=124303) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:37:47.004139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d4e8034e-9517-40e4-a500-bbb2ab84fb28 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action" status: 202 len: 0 microversion: 2.1 time: 0.151223 Jun 24 10:37:47.008580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 166/332] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:37:46 2022] POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:37:47.015277 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:47.015896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:47.035349 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=8 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:47.065055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.065055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.065055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.065055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.069527 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:47.070277 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:47.096616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.097108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.097890 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.098326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.409524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.422927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.426734 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7ed20a31-644c-45eb-966a-7fc652cb15c1 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1709 microversion: 2.1 time: 0.415853 Jun 24 10:37:47.427609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 167/333] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:47 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1709 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:47.435311 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.440828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.440828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-597ccfb0-6126-4cc5-bffd-d2fbc67f3a34 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.405685 Jun 24 10:37:47.458074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 167/334] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:47 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:47.529160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:47.529771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:47.536062 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.536697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.537538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.538200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.680913 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:47.681675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:47.692317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.694086 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.695952 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:47.696388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:47.836414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.847935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a19adeb3-11dd-4454-9541-9a2fa8e5cb22 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.322343 Jun 24 10:37:47.858137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 168/335] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:47 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:47.909663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:47.917270 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8f2a2281-a5eb-46db-9405-2611f2cfc53e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1318 microversion: 2.1 time: 0.240139 Jun 24 10:37:47.918262 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 168/336] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:47 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:48.044300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-cea507d5-7deb-455e-8913-34210376af54 req-6cb6fdd5-b671-4894-8f48-cd1489cff043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:48.061391 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-cea507d5-7deb-455e-8913-34210376af54 req-6cb6fdd5-b671-4894-8f48-cd1489cff043 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.061921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-cea507d5-7deb-455e-8913-34210376af54 req-6cb6fdd5-b671-4894-8f48-cd1489cff043 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.083150 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-cea507d5-7deb-455e-8913-34210376af54 req-6cb6fdd5-b671-4894-8f48-cd1489cff043 service nova] Creating event network-changed:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:37:48.088275 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-cea507d5-7deb-455e-8913-34210376af54 req-6cb6fdd5-b671-4894-8f48-cd1489cff043 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048562 Jun 24 10:37:48.092559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 169/337] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:48.469734 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:48.470433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:48.473864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:48.474763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:48.481763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.482655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.483232 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.483863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.484199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.484307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.484846 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.485000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.845767 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:48.847652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:48.854951 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-25d53bcb-0181-4994-91cb-87e29e4fdb53 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1709 microversion: 2.1 time: 0.408638 Jun 24 10:37:48.856438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 169/338] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:48 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1709 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:48.857472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:48.860914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:48.862134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-418b24ad-0c44-4fe1-8b3a-ed3ac3c43ad9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1743 microversion: 2.20 time: 0.400210 Jun 24 10:37:48.872988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 170/339] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:48 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1743 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:48.876154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:48.876856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:48.884918 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.885370 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.886249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.886772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.935297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:48.936047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:48.942725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.943175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:48.946215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:48.946714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:49.191166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:49.199614 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2ca1a919-653d-469a-9835-e8afa003106f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.330821 Jun 24 10:37:49.200508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 170/340] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:48 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:49.244579 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:49.253458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4fc5a8b2-9bf4-4aa2-8ea8-9f2cce670c50 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1506 microversion: 2.1 time: 0.322917 Jun 24 10:37:49.254488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 171/341] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:48 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:37:49.873533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:49.875574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:49.881181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:49.881535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:49.881961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:49.882179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:49.882606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:49.883140 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:49.888957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:49.889693 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:49.890724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:49.891508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:50.125119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:50.132909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:50.135510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8450acbe-328c-40f3-a5d6-ec1c1735f2a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1709 microversion: 2.1 time: 0.266199 Jun 24 10:37:50.137437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 171/342] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:49 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1709 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:50.143319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:50.144873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:50.146047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5b5aea0b-38e9-4057-b95f-c55d8fafb91f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1743 microversion: 2.20 time: 0.269158 Jun 24 10:37:50.146603 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 172/343] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:49 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:50.217787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:50.218309 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:50.224871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:50.225323 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:50.226087 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:50.226540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:50.369483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:50.377721 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-fc06fb5d-6ec3-496a-9362-1248a48fb91f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.164317 Jun 24 10:37:50.378315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 172/344] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:50 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:50.449788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-b4ed9823-5291-48e8-9f60-928720e2a73d req-4a14d77d-ca24-4b04-8323-6493c039d938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "name": "network-vif-plugged", "status": "completed", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:50.458271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b4ed9823-5291-48e8-9f60-928720e2a73d req-4a14d77d-ca24-4b04-8323-6493c039d938 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:50.459348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-b4ed9823-5291-48e8-9f60-928720e2a73d req-4a14d77d-ca24-4b04-8323-6493c039d938 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:50.473901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-b4ed9823-5291-48e8-9f60-928720e2a73d req-4a14d77d-ca24-4b04-8323-6493c039d938 service nova] Creating event network-vif-plugged:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:37:50.478817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-b4ed9823-5291-48e8-9f60-928720e2a73d req-4a14d77d-ca24-4b04-8323-6493c039d938 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 Jun 24 10:37:50.479414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 173/345] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:51.154685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:51.155461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:51.162404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.162887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.163650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.164080 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.164307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:51.165019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:51.166724 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:51.171897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.172336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.173100 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.173537 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.358214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:51.366410 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-df2d47bb-ae88-4be4-8a12-d15bbb12f80b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1713 microversion: 2.1 time: 0.215758 Jun 24 10:37:51.367406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 173/346] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:51 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1713 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:51.369923 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:51.385510 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:51.390560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:51.392811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0e07ea2b-3f7f-4d8e-832c-795e3187d209 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1743 microversion: 2.20 time: 0.232748 Jun 24 10:37:51.395288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:51.396119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:51.404055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 174/347] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:51 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1743 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:51.405421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.405874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.406657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:51.407294 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:51.630492 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:51.642389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7a57c38e-97a2-420c-bbb9-141f3234c029 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.250817 Jun 24 10:37:51.643116 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 174/348] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:51 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:52.411097 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:52.411667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:52.418690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:52.419138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:52.419899 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:52.420330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:52.566650 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:52.577115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:52.580198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:52.582032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bb576f36-96f5-405b-88ce-91f7e3f578f4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.174811 Jun 24 10:37:52.586454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 175/349] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:52 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:52.661635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:52.662347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:52.669365 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:52.670109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:52.670895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:52.671323 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:52.803874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:52.812084 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7aa08aca-6e50-470c-9f95-a77882a3e684 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.154623 Jun 24 10:37:52.812668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 175/350] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:52 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:53.606488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:53.607400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:53.619108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:53.619911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:53.621335 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:53.622108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:53.762510 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:53.773422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:53.775771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:53.777639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3466ceb3-2423-4c48-870c-a4572d78913b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.177749 Jun 24 10:37:53.778573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 176/351] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:53 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:53.829340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:53.829889 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:53.837662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:53.838196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:53.839045 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:53.839476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:53.992157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:54.001366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b563abcd-4df2-481d-b2c6-e6558e17cb5c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.175950 Jun 24 10:37:54.001942 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 176/352] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:53 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:54.508054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-d8e3c8f2-34cf-4c23-a1be-e2b9f81ade68 req-88d32528-5101-4721-bae8-5ba1b5f40600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "name": "network-vif-plugged", "status": "completed", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:54.511738 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:54.512435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=12 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:54.518838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-d8e3c8f2-34cf-4c23-a1be-e2b9f81ade68 req-88d32528-5101-4721-bae8-5ba1b5f40600 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:54.519263 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-d8e3c8f2-34cf-4c23-a1be-e2b9f81ade68 req-88d32528-5101-4721-bae8-5ba1b5f40600 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:54.531752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-d8e3c8f2-34cf-4c23-a1be-e2b9f81ade68 req-88d32528-5101-4721-bae8-5ba1b5f40600 service nova] Creating event network-vif-plugged:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:37:54.536671 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-d8e3c8f2-34cf-4c23-a1be-e2b9f81ade68 req-88d32528-5101-4721-bae8-5ba1b5f40600 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032845 Jun 24 10:37:54.537312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 177/353] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:54.797395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:54.798043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:54.804953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:54.805357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:54.806131 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:54.806567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:54.949804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:54.960519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:54.962200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:54.964100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4ac41e2b-471d-42b8-ad6a-5e1bf01c1f23 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.170328 Jun 24 10:37:54.964854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 177/354] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:54 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:55.023517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:55.024797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:55.035065 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:55.035515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:55.036286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:55.036721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:55.055295 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=100 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:55.179540 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:55.188016 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-da0897e6-c3e4-47b4-89d2-a2af463a1bcd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.171580 Jun 24 10:37:55.188640 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 178/355] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:55 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:55.988931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:55.989513 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:55.996276 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:55.996729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:55.997601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:55.998206 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:56.131645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:56.140011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:56.141576 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:56.142770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-30e0063a-2ce0-4901-94dc-9cfcbafb2e6a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.160843 Jun 24 10:37:56.143432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 178/356] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:55 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:56.207721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:56.208303 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:56.215443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:56.215882 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:56.217025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:56.217449 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:56.360968 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:56.368681 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6d471b39-6a8d-41ee-9ef3-c54e4c1295bb tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1372 microversion: 2.1 time: 0.166724 Jun 24 10:37:56.369291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 179/357] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:56 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:57.161520 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:57.162816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:57.169905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.170355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.171119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.171581 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.311180 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:57.319516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:57.321082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:57.322253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0ee20631-5168-471c-8308-9b5f92d062e2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.165426 Jun 24 10:37:57.322830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 179/358] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:57 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:57.386425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:57.386984 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:57.394474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.394966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.395753 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.396909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.549451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:57.560028 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-772fca15-d6ed-4b3d-8471-4876063d4343 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1567 microversion: 2.1 time: 0.177324 Jun 24 10:37:57.560792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 180/359] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:37:57 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:37:57.584542 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:57.585188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:57.592528 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.593004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.593777 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:57.594204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:57.683692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a6c53039-9147-400f-95ff-9d49742f9622 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104626 Jun 24 10:37:57.684318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 180/360] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:37:57 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:58.350710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:58.351312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:58.357651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:58.358338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:58.358828 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:58.359268 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:58.499509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:58.510186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:58.511684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:58.512878 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8dff2efa-021b-4961-bc02-792870c1a02e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.167958 Jun 24 10:37:58.513474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 181/361] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:58 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:37:58.674977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-94017a83-8981-42e4-af8b-1548cf2fc5fe req-bc309979-5c87-4846-b873-bc15fdc755f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:37:58.685334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-94017a83-8981-42e4-af8b-1548cf2fc5fe req-bc309979-5c87-4846-b873-bc15fdc755f8 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:58.685785 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-94017a83-8981-42e4-af8b-1548cf2fc5fe req-bc309979-5c87-4846-b873-bc15fdc755f8 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:58.697822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-94017a83-8981-42e4-af8b-1548cf2fc5fe req-bc309979-5c87-4846-b873-bc15fdc755f8 service nova] Creating event network-changed:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:37:58.703556 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-94017a83-8981-42e4-af8b-1548cf2fc5fe req-bc309979-5c87-4846-b873-bc15fdc755f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033572 Jun 24 10:37:58.704361 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 181/362] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:37:59.531733 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:37:59.532422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:37:59.535690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:59.542615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:59.543527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:59.544497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:37:59.545106 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:37:59.693404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:59.702900 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:59.704518 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:37:59.709592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-14632584-73fa-4ffa-859f-72c5ac2e760b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.182182 Jun 24 10:37:59.710225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 182/363] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:37:59 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:00.729763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:00.730635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:00.737412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:00.737859 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:00.738641 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:00.739069 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:00.891400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:00.899932 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:00.901415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:00.902641 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6a724e65-f62b-48b0-81d6-7aed26d97fe5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.177870 Jun 24 10:38:00.903175 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 182/364] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:00 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:01.923218 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:01.923990 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:01.934609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:01.935276 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:01.936497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:01.937127 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:02.082855 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:02.092539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:02.094072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:02.095243 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-43259002-f515-466a-ab15-831c1cb3de70 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.178573 Jun 24 10:38:02.095765 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 183/365] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:01 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:03.115868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:03.116783 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:03.124270 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:03.124723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:03.125603 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:03.126036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:03.266973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:03.275036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:03.276529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:03.277811 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f7a544a3-fe17-446c-9ead-958a3945742d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.167056 Jun 24 10:38:03.278403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 183/366] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:03 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:04.296933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:04.298010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:04.306844 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:04.307275 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:04.308250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:04.308675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:04.474109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:04.482739 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:04.484635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:04.486622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fbf17447-2ffe-4113-9dbc-dc7a8b7bfca0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.194703 Jun 24 10:38:04.497272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 184/367] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:04 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:05.509698 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:05.511203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:05.516604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:05.522020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:05.522690 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:05.523636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:05.524075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:05.691408 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:05.700517 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:05.701999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:05.704213 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-be2d81d7-f4cb-4252-afcf-ec6213883bca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.201272 Jun 24 10:38:05.715384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 184/368] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:05 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:06.722492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:06.723813 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:06.731147 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:06.731585 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:06.732357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:06.732818 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:06.875191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:06.887108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:06.888724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:06.890159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-90c4c182-4378-4c2f-af11-63dbdf5e9b61 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.171711 Jun 24 10:38:06.891264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 185/369] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:06 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:07.911822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:07.912448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:07.919568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:07.920016 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:07.921121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:07.921955 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:08.113927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:08.128611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:08.130536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:08.131735 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-05e3ce79-bd5c-45cd-9dc3-022728104fcb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.224149 Jun 24 10:38:08.132295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 185/370] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:07 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:09.151074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:09.151692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:09.161307 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:09.161911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:09.162876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:09.163488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:09.314206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:09.325237 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:09.326777 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:09.328038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-17b495d4-9d02-4bea-94d1-65fbea27a333 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.180921 Jun 24 10:38:09.328602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 186/371] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:09 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:10.347252 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:10.348028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:10.355147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:10.355870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:10.356851 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:10.357286 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:10.507051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:10.517650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:10.519154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:10.521616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c6495927-8a2a-4a5e-a292-0f992d195f2a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.178347 Jun 24 10:38:10.525035 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 186/372] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:10 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:11.540784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:11.542119 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:11.549365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:11.550022 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:11.550932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:11.551511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:11.699032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:11.707413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:11.709186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:11.710394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cd9685ff-5030-4092-b539-14b6f45c725a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.173582 Jun 24 10:38:11.711130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 187/373] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:11 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:38:12.729335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:12.729891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:12.737279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:12.737729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:12.738499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:12.738938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:12.886895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:12.896169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:12.897892 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:12.899070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a8128ced-c8c5-4463-96ce-1f03a5d7a54f tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1738 microversion: 2.20 time: 0.173771 Jun 24 10:38:12.899875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 187/374] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:12 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:13.918685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:13.919381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:13.927263 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:13.927718 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:13.928723 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:13.929178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:14.138659 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:14.147752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:14.150274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:14.152255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2304f1f4-e0f5-462f-9410-65f7c8ae9ea1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1720 microversion: 2.20 time: 0.237712 Jun 24 10:38:14.152917 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 188/375] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:13 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:15.174762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:15.176168 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:15.186432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:15.187045 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:15.187926 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:15.188356 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:15.328264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:15.336561 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:15.338173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:15.339354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c9097f56-2685-413a-830d-61d388cd6516 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1720 microversion: 2.20 time: 0.171308 Jun 24 10:38:15.339948 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 188/376] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:15 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:16.362241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:16.363093 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:16.374341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:16.375054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:16.376273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:16.376697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:16.514915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-d600354b-8f62-4d06-9d3d-636db77204ce req-d3edbff3-247c-4773-a4e9-99b486218e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "name": "network-vif-unplugged", "status": "completed", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:16.524314 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:16.525055 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-d600354b-8f62-4d06-9d3d-636db77204ce req-d3edbff3-247c-4773-a4e9-99b486218e8c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:16.525652 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-d600354b-8f62-4d06-9d3d-636db77204ce req-d3edbff3-247c-4773-a4e9-99b486218e8c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:16.533192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:16.535006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:16.536176 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-106c44e9-62e9-439e-b45f-afb9a9413c80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1720 microversion: 2.20 time: 0.181229 Jun 24 10:38:16.536752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 189/377] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:16 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:16.543325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-d600354b-8f62-4d06-9d3d-636db77204ce req-d3edbff3-247c-4773-a4e9-99b486218e8c service nova] Creating event network-vif-unplugged:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:38:16.548616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-d600354b-8f62-4d06-9d3d-636db77204ce req-d3edbff3-247c-4773-a4e9-99b486218e8c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037917 Jun 24 10:38:16.549277 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 189/378] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:38:17.555019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:17.555606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:17.562555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:17.562994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:17.563756 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:17.564221 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:17.698614 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:17.706754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:17.708231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:17.709416 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e8750281-fae4-4426-800c-185576be8aa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1663 microversion: 2.20 time: 0.158357 Jun 24 10:38:17.709963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 190/379] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:17 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:17.736953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de5374cb-37c4-48ff-8703-f71e41649f64"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:17.738006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:17.744435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:17.744913 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:17.745662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:17.746089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:17.935187 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:18.065531 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ec202667-8d15-423d-b676-ababf6be9f9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335473 Jun 24 10:38:18.066402 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 190/380] 10.222.0.69 () {62 vars in 1363 bytes} [Fri Jun 24 10:38:17 2022] POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:38:18.192932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:18.193516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:18.199657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:18.200131 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:18.200917 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:18.201353 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:18.304550 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f93f7a10-b08a-46c2-acbb-55e0995c486c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/action" status: 202 len: 0 microversion: 2.20 time: 0.116222 Jun 24 10:38:18.305078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 191/381] 10.222.0.69 () {62 vars in 1318 bytes} [Fri Jun 24 10:38:18 2022] POST /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:38:18.313669 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:18.314337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:18.321332 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:18.321779 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:18.322537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:18.322996 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:18.459382 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:18.468405 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:18.470067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:18.471445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b1ee64ff-8080-41ab-8593-e600c9769e87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1749 microversion: 2.20 time: 0.161616 Jun 24 10:38:18.471991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 191/382] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:18 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:19.490605 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:19.491219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:19.497655 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:19.498095 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:19.498849 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:19.499271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:19.629421 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:19.637994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:19.639486 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:19.640663 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a5975d06-61cd-402c-8ba5-bd934aa5f62c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1751 microversion: 2.20 time: 0.154895 Jun 24 10:38:19.641269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 192/383] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:19 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:20.659795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:20.660359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:20.667151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:20.667599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:20.668366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:20.668789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:20.853246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:20.862392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:20.864032 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:20.865234 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a96eb754-7343-41e7-a0d0-f0553732c765 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.209510 Jun 24 10:38:20.865781 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 192/384] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:20 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:21.396848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ecebd05-cff7-4d0b-bef5-500f325aabd2", "device": "/dev/sdb"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:21.398653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:21.405711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:21.406256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:21.407023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:21.407484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:21.559973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:21.759820 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b5ef873b-e147-4fcb-9749-ff18c1fc19a2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "POST /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366241 Jun 24 10:38:21.760932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 193/385] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:38:21 2022] POST /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:38:21.884028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:21.884571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:21.898571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:21.899416 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:21.900508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:21.901424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:22.099456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:22.114830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:22.116658 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:22.118036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6f978677-6263-4367-b03e-0503e08abc73 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.238543 Jun 24 10:38:22.125755 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 193/386] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:21 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:23.147509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:23.150770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:23.160792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:23.161569 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:23.162874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:23.163473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:23.343466 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:23.355373 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:23.357610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:23.361766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-32911e28-118a-45c2-a97d-d5674d27cd45 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.222519 Jun 24 10:38:23.362390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 194/387] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:23 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:24.381324 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:24.382732 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:24.391249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:24.392250 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:24.393570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:24.394706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:24.546253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:24.575851 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:24.577530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:24.581053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f41ecf38-0b64-4304-b17e-b61bf814fadd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.203615 Jun 24 10:38:24.593580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 194/388] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:24 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:25.599948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:25.600669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:25.607269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:25.607708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:25.608473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:25.608966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:25.757862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:25.766318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:25.767800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:25.769407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0f7473b7-464f-4e38-99d5-2f5876cd98d9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.173537 Jun 24 10:38:25.769947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 195/389] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:25 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:38:26.788150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:26.788837 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:26.795500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:26.795971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:26.796760 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:26.797212 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:26.945332 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:26.954281 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:26.955803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:26.957031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8a520ce3-01ba-4550-9664-cd863c33637e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.173260 Jun 24 10:38:26.957602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 195/390] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:26 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:27.975059 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:27.975833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:27.982714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:27.983163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:27.983925 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:27.984358 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:28.120387 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:28.129646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:28.131483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:28.132671 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6366cf14-f5c7-4a65-8a28-85b2157e1a09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.161900 Jun 24 10:38:28.133264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 196/391] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:27 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:29.154974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:29.155991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:29.165502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:29.165950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:29.166754 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:29.167174 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:29.333036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:29.342683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:29.344291 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:29.345567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e3588ce9-d939-4246-8c2e-e3199f45a156 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.197305 Jun 24 10:38:29.346203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 196/392] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:29 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:30.363590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:30.364276 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:30.367404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=32 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:30.373096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:30.373556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:30.374303 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:30.374729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:30.528249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:30.537379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:30.539197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:30.540643 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4b6eb637-071b-4f08-8cb6-5b43b642c812 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.180990 Jun 24 10:38:30.541473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 197/393] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:30 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:31.575328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:31.583263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:31.610293 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:31.610639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:31.611404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:31.611827 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:31.745503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:31.754512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:31.756452 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:31.757845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0c1887d4-3183-47af-9b26-819b71088fa6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.199352 Jun 24 10:38:31.758609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 197/394] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:31 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:32.781288 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:32.782250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:32.791522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:32.791959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:32.792776 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:32.793201 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:32.929255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:32.938075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:32.939567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:32.940695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ece2a447-0d33-40e8-9a21-c2792022e43a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.166226 Jun 24 10:38:32.941325 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 198/395] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:32 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:33.960364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:33.961079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:33.969027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:33.969539 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:33.970369 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:33.970818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:34.106567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:34.118312 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:34.119825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:34.121938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-16af1d2a-529a-4975-9056-4b6fc9760719 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.165018 Jun 24 10:38:34.125636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 198/396] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:33 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:35.143933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:35.144986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:35.155915 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:35.156661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:35.157971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:35.158688 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:35.293242 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:35.301706 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:35.303200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:35.304358 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f55616d1-4f45-44f3-a688-d3656777bba3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.167220 Jun 24 10:38:35.304924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 199/397] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:35 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:36.327364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:36.328001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:36.330424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=30 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:36.336207 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:36.336659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:36.337628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:36.338070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:36.484757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:36.493479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:36.495320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:36.496708 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-63029758-cba7-42b7-a209-8c6ca111b6de tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.173203 Jun 24 10:38:36.497387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 199/398] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:36 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:37.519883 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:37.520933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:37.529600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:37.530042 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:37.530790 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:37.531211 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:37.672157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:37.680773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:37.682711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:37.683868 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f801fb45-c9e4-498a-bf8c-b16e37e55733 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.170509 Jun 24 10:38:37.684424 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 200/399] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:37 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:38.702525 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:38.703087 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:38.710348 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:38.710620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:38.711524 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:38.712012 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:38.858466 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:38.867364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:38.868855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:38.870066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6e438f43-9fb0-403a-bd2f-0354d338a1a1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.171588 Jun 24 10:38:38.870635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 200/400] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:38 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:39.887744 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:39.888352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:39.905296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:39.905717 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:39.906500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:39.906957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:40.042835 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:40.053630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:40.055133 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:40.056555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5d74b012-0e98-438a-b811-c1571ca4fa9c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.173010 Jun 24 10:38:40.057572 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 201/401] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:39 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:41.075277 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:41.075861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:41.101249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:41.101732 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:41.102541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:41.103084 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:41.256876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:41.265812 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:41.267391 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:41.268646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-18bd007b-3072-4d7d-b266-27270fa27dc4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.197440 Jun 24 10:38:41.269331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 201/402] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:41 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:42.288517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:42.289833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:42.301334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:42.304189 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:42.308343 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:42.308905 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:42.514336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:42.523470 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:42.525431 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:42.527207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-673f7805-8e34-4d26-8cfb-06c044d869a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.244038 Jun 24 10:38:42.528488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 202/403] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:42 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:43.546697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:43.548155 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:43.555113 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:43.555832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:43.557062 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:43.557765 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:43.709035 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:43.718567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:43.720061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:43.723956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5b8ca508-c22b-46c3-bed8-b6ccdf1333c2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.181355 Jun 24 10:38:43.738027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 202/404] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:43 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:44.748574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:44.749329 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:44.757747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:44.758279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:44.759166 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:44.759819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:44.908140 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:44.919908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:44.921551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:44.923175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bb56dda8-ce00-418f-8bd4-ca684cbafa1e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.183046 Jun 24 10:38:44.923782 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 203/405] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:44 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:45.941533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:45.942142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:45.952832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:45.953383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:45.954235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:45.954671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:46.124722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:46.134290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:46.140138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:46.141529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9a01d4ec-98b1-40cd-8187-75f81febaf75 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.203891 Jun 24 10:38:46.143279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 203/406] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:45 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:47.161972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:47.162641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:47.171378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:47.171820 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:47.172865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:47.173332 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:47.354461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:47.377479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:47.379324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:47.385014 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-97e7c7a4-c20d-44f6-8d88-77c41f044b71 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.227029 Jun 24 10:38:47.386116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 204/407] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:47 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:48.403930 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:48.404593 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:48.416305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:48.416768 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:48.417572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:48.417999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:48.462311 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:48.779665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:48.793529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:48.795827 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:48.797233 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6055b600-7b84-4cf6-99c9-5e00587aaec0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.397547 Jun 24 10:38:48.810684 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 204/408] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:48 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:49.821631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:49.823793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:49.835179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:49.836347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:49.837948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:49.838878 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:50.162978 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:50.173408 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:50.179563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:50.184639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f51f111d-d1be-4046-b957-933740da2186 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.372535 Jun 24 10:38:50.185782 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 205/409] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:49 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:50.917057 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Action: 'create', calling method: .version_select at 0x7f17629d8670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-198254431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHk8KqZzj+QYIUaNGlpxhRsOX1gLX++9s0tos1j5Gclmm+Tmg4UcnhwWEawLUHj6fYFcMeW+qFqvXlVUIb/2J2W7IBaARxHnFlTy/dPtnyh5rQef1ZycgotZtEaW12qZQw=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:50.933833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:38:50.938678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for user 5fc073d480884782b4084952345382b9 and project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:38:50.959134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [fffb18ae-6349-44f3-84d7-b5c9f03c8b2e] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 10:38:51.203701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:51.204305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:51.211509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:51.211943 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:51.212987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:51.213508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:51.365971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:51.375294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:51.376859 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:51.378074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-257bf5cb-0b60-456b-ab42-b9e46a5e9fca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.178662 Jun 24 10:38:51.378644 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 206/410] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:51 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:51.969326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [fffb18ae-6349-44f3-84d7-b5c9f03c8b2e] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 58984. Jun 24 10:38:51.990461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-af5570ec-327e-47cf-87de-7f4faa7e1a51 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.349622 Jun 24 10:38:51.991493 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 205/411] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:38:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:38:52.396526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:52.397152 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:52.404009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:52.404389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:52.405222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:52.405666 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:52.409906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:52.559265 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:52.569112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:52.570783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:52.571897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4d60d4d3-6034-47ec-9ddf-b76afca731ba tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.179446 Jun 24 10:38:52.572455 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 207/412] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:52 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:53.591222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:53.592341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:53.598686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:53.599220 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:53.600066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:53.600567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:53.795008 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:53.806204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:53.809874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:53.811686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6bb38b47-8866-44cd-bb52-04e17d48511b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.225104 Jun 24 10:38:53.828573 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 206/413] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:53 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:54.144142 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5312f43-3355-4ad8-a35a-67ff5dd12987"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:54.145562 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:54.162658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.163446 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.165415 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.166601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.531483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:54.532150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:54.545973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ab1baf4c-969a-4545-a114-7ac10504a6b9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405372 Jun 24 10:38:54.546205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.546659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.546984 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 208/414] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:38:54 2022] POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:38:54.547444 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.547944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.720348 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lazy-loading 'services' on Instance uuid 332b01da-30de-4466-9408-485f644e52f7 {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:38:54.838758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:54.839484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:54.847048 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.847753 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.848564 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:54.849107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:54.855816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6a427dbb-d658-4544-877b-2d941321d3d5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments/421de70c-bcee-441b-96e6-e3004fcf09b7" status: 202 len: 0 microversion: 2.1 time: 0.327862 Jun 24 10:38:54.859618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 207/415] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:38:54 2022] DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments/421de70c-bcee-441b-96e6-e3004fcf09b7 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:38:54.994567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:55.003981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:55.005520 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:55.006713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d8ab9e86-f257-4447-80cf-874f1524803c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.177927 Jun 24 10:38:55.007272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 209/416] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:54 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:38:56.026166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:56.026852 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:56.033724 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:56.034165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:56.034923 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:56.035354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:56.171073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:56.179729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:56.181244 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:56.182411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b2960032-5097-4239-95a9-7c15a7449904 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.160711 Jun 24 10:38:56.182977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 208/417] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:56 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:56.834457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-af87512a-1dab-4a2d-8383-03adff851290 req-63a5b981-e2ff-4ed2-80aa-ab5326bb25cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "name": "network-vif-plugged", "status": "completed", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:38:56.846081 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-af87512a-1dab-4a2d-8383-03adff851290 req-63a5b981-e2ff-4ed2-80aa-ab5326bb25cb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:56.846546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-af87512a-1dab-4a2d-8383-03adff851290 req-63a5b981-e2ff-4ed2-80aa-ab5326bb25cb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:56.861388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-af87512a-1dab-4a2d-8383-03adff851290 req-63a5b981-e2ff-4ed2-80aa-ab5326bb25cb service nova] Creating event network-vif-plugged:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:38:56.866533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-af87512a-1dab-4a2d-8383-03adff851290 req-63a5b981-e2ff-4ed2-80aa-ab5326bb25cb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Jun 24 10:38:56.867544 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 210/418] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:38:57.200992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:57.201937 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:57.209668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:57.210119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:57.210890 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:57.211325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:57.371250 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:57.374902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:57.376414 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:57.377637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-03774e56-ba74-4c11-bbbd-5deebe432307 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.180633 Jun 24 10:38:57.378166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 209/419] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:57 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:58.396512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:58.397229 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:58.403546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:58.403998 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:58.404993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:58.405406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:58.546349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:58.558219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:58.560678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:58.562336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-67589a50-6bef-4bc4-a077-5dad507c7e6b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.170447 Jun 24 10:38:58.562974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 211/420] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:58 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:38:59.581040 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:38:59.582096 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:38:59.590682 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:59.591198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:59.592422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:38:59.593018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:38:59.754687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:59.766839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:59.768565 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:38:59.770172 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3663f4a6-5977-4111-80b8-146f2337cf33 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.193390 Jun 24 10:38:59.770902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 210/421] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:38:59 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:39:00.789766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:00.790376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:00.792931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=30 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:00.798620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:00.799082 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:00.799839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:00.800311 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:00.938658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:00.947573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:00.949122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:00.950278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4aeb20d6-dc5d-4a4c-8c57-220323cac7a9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.164471 Jun 24 10:39:00.951000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 212/422] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:39:00 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:39:01.971128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:01.971832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:01.975036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=4 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:01.983299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:01.983847 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:01.984831 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:01.985384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:02.127855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:02.137080 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:02.138624 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:02.139814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-97260e42-bf08-4f8c-abcc-46b423b22ce7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.174345 Jun 24 10:39:02.140433 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 211/423] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:39:01 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:39:03.159471 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:03.160105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:03.166928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:03.167376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:03.168123 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:03.168551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:03.311047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:03.320542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:03.322065 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:03.323231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b264e91b-0947-463b-8933-6e3beb312b4e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.167831 Jun 24 10:39:03.323814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 213/424] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:39:03 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:39:04.343582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:04.345101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:04.353746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:04.354201 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:04.354984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:04.355417 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:04.503167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:04.515804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:04.518083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:04.519348 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cfe57640-1a3f-4e42-b174-7283e04b424e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1807 microversion: 2.20 time: 0.181137 Jun 24 10:39:04.520107 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 212/425] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:39:04 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:39:05.272937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:05.273914 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:05.281061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.281500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.282250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.282669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.305933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lazy-loading 'flavor' on Instance uuid 6456f179-5c11-462c-920a-a8939662cdde {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:39:05.431013 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2a3403e5-d43f-4b3d-b03b-ea934d3e5904 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/action" status: 200 len: 32 microversion: 2.1 time: 0.162023 Jun 24 10:39:05.431539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 214/426] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:39:05 2022] POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:39:05.440856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:05.441476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:05.448312 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.448783 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.449549 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.449982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.538466 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:05.539296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:05.545788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.546241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.547010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:05.547473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:05.583985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:05.592756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a8d15dda-8ce1-453d-84ae-0f74d668e5f9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.155715 Jun 24 10:39:05.593376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 213/427] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:05 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:05.690370 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:05.699477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:05.700993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:05.702164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ec110341-ebb3-4371-a703-9ee5e6de99ea tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1794 microversion: 2.20 time: 0.168017 Jun 24 10:39:05.702730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 215/428] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:39:05 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:39:06.617668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:06.618620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:06.621599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:06.627248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:06.627946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:06.628727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:06.629188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:06.764039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:06.773411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c579ac03-c911-460b-95c5-3996d0244352 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.165171 Jun 24 10:39:06.773993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 214/429] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:06 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:07.794001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:07.794597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:07.801529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:07.801966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:07.802717 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:07.803140 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:07.943238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:07.951572 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6d95d3aa-f684-4e42-871a-72be77325e2d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.163337 Jun 24 10:39:07.952151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 216/430] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:07 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:08.688000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-88df2fe2-8239-45c8-bd7a-3ef353cfd01e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:08.695387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-88df2fe2-8239-45c8-bd7a-3ef353cfd01e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:08.695837 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-88df2fe2-8239-45c8-bd7a-3ef353cfd01e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:08.719453 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-88df2fe2-8239-45c8-bd7a-3ef353cfd01e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Going to try to stop instance {{(pid=124303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:39:08.764333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-88df2fe2-8239-45c8-bd7a-3ef353cfd01e tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action" status: 202 len: 0 microversion: 2.1 time: 0.080681 Jun 24 10:39:08.764916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 215/431] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:39:08 2022] POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:39:08.774053 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:08.774904 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:08.782049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:08.782520 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:08.783281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:08.783700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:08.924704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:08.932973 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a252d43e-5536-40c1-a207-b3ae7b9eb95b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.163661 Jun 24 10:39:08.933786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 217/432] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:08 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:08.970137 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:08.970832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:08.977123 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:08.977560 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:08.978317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:08.978745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:09.111540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:09.121225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4300127b-076d-4c73-a6be-48d10ce09061 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.155677 Jun 24 10:39:09.121841 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 216/433] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:08 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:09.950243 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:09.950851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:09.957811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:09.958252 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:09.959015 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:09.959442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:10.099509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:10.107982 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e4c4e0be-3fef-4c3b-a98b-e563f9ea5502 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.161695 Jun 24 10:39:10.108556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 218/434] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:09 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:10.138663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:10.139275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:10.145971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:10.146490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:10.147316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:10.147745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:10.234400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:10.234826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:10.241213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:10.241653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:10.244188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:10.244675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:10.281950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:10.290225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-db8c9cce-c8e2-4df8-b835-4d1ca320ef95 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.155545 Jun 24 10:39:10.291147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 217/435] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:10 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:10.371024 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lazy-loading 'services' on Instance uuid 82903e26-c3ed-45b5-8ac6-df037373bd89 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:39:10.501677 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-27f54835-69d9-49de-821a-57b82f9d8d13 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "DELETE /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89/os-volume_attachments/3ecebd05-cff7-4d0b-bef5-500f325aabd2" status: 202 len: 0 microversion: 2.1 time: 0.271540 Jun 24 10:39:10.502609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 219/436] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:39:10 2022] DELETE /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89/os-volume_attachments/3ecebd05-cff7-4d0b-bef5-500f325aabd2 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:39:11.125364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:11.125965 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:11.132651 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.133284 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.133884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.134316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.276497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:11.285478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-75acf3c9-42cb-48c5-bc96-ee23d8801131 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.164032 Jun 24 10:39:11.286527 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 218/437] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:11 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:11.307668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:11.308354 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:11.316018 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.316456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.317233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.317676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.335706 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:11.624354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:11.624875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:11.632582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.633100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.633934 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.634419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.662439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:39:11.679122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:11.705883 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:11.714411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1ee99a0a-b2f1-4ffe-9b3d-5953e3d52905 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.410874 Jun 24 10:39:11.715195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 220/438] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:11 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:11.757817 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-146c344c-040d-4414-82c5-ab58d8892faf tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "DELETE /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 204 len: 0 microversion: 2.1 time: 0.137501 Jun 24 10:39:11.758412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 219/439] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:39:11 2022] DELETE /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:11.766835 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:11.767439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:11.773741 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.774184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.774939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:11.775379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:11.913342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:11.921291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-721da5e1-2b1f-4b71-8f0d-70abca1980a6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1512 microversion: 2.1 time: 0.158498 Jun 24 10:39:11.921863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 221/440] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:11 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:12.305744 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:12.306460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:12.314369 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.314821 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:12.315588 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.316022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:12.467902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:12.475661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7b4b3fe3-f6ca-4cdc-8129-5201c24c5d0c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.175129 Jun 24 10:39:12.476444 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 220/441] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:12 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:12.734054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:12.734669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:12.741643 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.742090 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:12.742843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.743272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:12.878939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:12.887290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-25def32f-fbd2-41f1-9b4f-300d4da21fe9 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.157324 Jun 24 10:39:12.887872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 222/442] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:12 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:12.938255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:12.938862 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:12.945069 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.945488 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:12.946273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:12.946705 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:13.078928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:13.086819 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-05ab8b43-8f2b-41fd-8603-c07b808053ff tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1512 microversion: 2.1 time: 0.152568 Jun 24 10:39:13.087523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 221/443] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:12 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:13.493888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:13.494582 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:13.501128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:13.501577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:13.502639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:13.503075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:13.637194 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:13.645257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3cfe7fbe-5217-4685-975f-99810884c175 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.155107 Jun 24 10:39:13.645908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 223/444] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:13 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:13.904656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:13.906341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:13.913632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:13.914327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:13.915175 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:13.915809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.054794 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:14.062993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-61d0a38c-0632-46f2-8431-44f040c142cd tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.162588 Jun 24 10:39:14.063535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 222/445] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:13 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:14.105961 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:14.106624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:14.115533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:14.116178 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.117398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:14.118041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.340551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:14.349514 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-426ca19b-1b94-496e-91ac-cf4b317b0ec9 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 200 len: 1512 microversion: 2.1 time: 0.247654 Jun 24 10:39:14.350153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 224/446] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:14 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:14.662516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:14.663430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:14.670513 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:14.670936 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.671909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:14.672333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.673803 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1715717596", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198254431", "security_groups": [{"name": "tempest-secgroup-smoke-1102130013"}], "block_device_mapping_v2": [{"uuid": "abecc1f6-fce2-4765-9ef2-bb5b93a2a307", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3da010b-27ad-4a9f-8afe-32b8ee29d12d"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:14.841065 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] validate_networks() for [('a3da010b-27ad-4a9f-8afe-32b8ee29d12d', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:39:14.850288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:14.859779 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-19943dfa-4026-482d-b545-7a17a419e599 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.201139 Jun 24 10:39:14.860355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 223/447] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:14 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:14.864886 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-c35596a3-5f5c-4fa8-9859-618829fea757 req-e8da296c-e28d-41f2-88ba-d7ebf4867077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82903e26-c3ed-45b5-8ac6-df037373bd89", "name": "network-vif-deleted", "tag": "32a01ad2-4b70-496e-b8f5-5e71cad379fc"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:14.873499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c35596a3-5f5c-4fa8-9859-618829fea757 req-e8da296c-e28d-41f2-88ba-d7ebf4867077 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:14.873938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c35596a3-5f5c-4fa8-9859-618829fea757 req-e8da296c-e28d-41f2-88ba-d7ebf4867077 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:14.885532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-c35596a3-5f5c-4fa8-9859-618829fea757 req-e8da296c-e28d-41f2-88ba-d7ebf4867077 service nova] Creating event network-vif-deleted:32a01ad2-4b70-496e-b8f5-5e71cad379fc for instance 82903e26-c3ed-45b5-8ac6-df037373bd89 on hv-cinder-84753 Jun 24 10:39:14.890758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-c35596a3-5f5c-4fa8-9859-618829fea757 req-e8da296c-e28d-41f2-88ba-d7ebf4867077 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029289 Jun 24 10:39:14.891398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 224/448] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:15.084331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:15.085067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:15.092999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.093449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.094227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.094665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.306403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:15.308016 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:39:15.308477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:39:15.309092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:39:15.309556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:39:15.310043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:39:15.314641 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b4defb9b-e9d0-42d7-aac8-2b0131ef883d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.234706 Jun 24 10:39:15.315214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 225/449] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:15 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:15.319738 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.320244 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.321125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.321614 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.342425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:39:15.346713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for user 5fc073d480884782b4084952345382b9 and project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:39:15.367272 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:15.367872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 82903e26-c3ed-45b5-8ac6-df037373bd89] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:15.374190 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.374632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.375400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.375828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.389858 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] HTTP exception thrown: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Request method failure captured: Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 HTTP/1.1 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZPtYY_XcO6_NVRV8dZopl2H4p7Aus0-2U2TAyKpt3bjcCb6PNCNgVPyrqG0vN1TO5Lqi6oZDBzxmP26sR4C0M4ZmbrPFIjMm3YyC6TehszwA7yFidq9lCAujbWc_dOjUxXRjqebN48SKPJJG9EggFdteKCSYAcFDlsBUkfrNPtVw78 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: b88db10e9091496a84e87446da50a3b6 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:39:15.391810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b88db10e9091496a84e87446da50a3b6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: b88db10e9091496a84e87446da50a3b6 Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesSnapshotTestJSON-710481972-project Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 60367bf464f4441483bfe4a1373a1e92 Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesSnapshotTestJSON-710481972-project Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. Jun 24 10:39:15.393157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '82903e26-c3ed-45b5-8ac6-df037373bd89'} Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:39:15.393974 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. Jun 24 10:39:15.395145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:39:15.396191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Returning 404 to user: Instance 82903e26-c3ed-45b5-8ac6-df037373bd89 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:39:15.396191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2429d441-f0ed-41b6-96bb-6efa638d2564 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89" status: 404 len: 111 microversion: 2.1 time: 0.029920 Jun 24 10:39:15.396191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 226/450] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:15 2022] GET /compute/v2.1/servers/82903e26-c3ed-45b5-8ac6-df037373bd89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:39:15.414682 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:39:15.417770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abecc1f6-fce2-4765-9ef2-bb5b93a2a307',volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:39:15.575221 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ea1db359-fa46-49c1-9fa9-c1defd930eff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.905205 Jun 24 10:39:15.576161 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 225/451] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:39:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:39:15.586574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1abc3184-0475-478e-b159-8b53fbbce216 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:15.586706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1abc3184-0475-478e-b159-8b53fbbce216 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:15.643841 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1abc3184-0475-478e-b159-8b53fbbce216 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:15.650607 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1abc3184-0475-478e-b159-8b53fbbce216 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1094 microversion: 2.1 time: 0.068427 Jun 24 10:39:15.651355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 227/452] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:15 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:15.876440 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:15.877078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:15.883649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.884094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:15.884886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:15.885324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:16.024935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:16.033783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-87492fd1-a8e3-4c2e-a057-0b243dd1b9ed tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.161079 Jun 24 10:39:16.034637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 226/453] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:15 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:16.331969 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:16.332582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:16.340255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:16.340871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:16.341959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:16.342760 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:16.499223 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:16.507884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4571cd00-9936-4d0b-af63-5e09824bbc08 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.179812 Jun 24 10:39:16.508459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 228/454] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:16 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:16.668060 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:16.668704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:16.676169 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:16.676607 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:16.677388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:16.677811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:16.742600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:16.752134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-76007b78-eddb-40eb-84fa-f270c81ae299 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1144 microversion: 2.1 time: 0.088239 Jun 24 10:39:16.752989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 227/455] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:16 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:17.052191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:17.053109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:17.060571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.061038 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.061812 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.062663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.204553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:17.212602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-71ba9c84-1655-4531-a12d-67c49e68dbf2 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.164781 Jun 24 10:39:17.213216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 229/456] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:17 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:17.525028 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:17.525426 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:17.531934 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.532483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.533169 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.533594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.674916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:17.684327 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e4ad83a9-03c9-4c79-abf6-67ff8d7cbac1 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.163384 Jun 24 10:39:17.684953 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 228/457] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:17 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:17.773423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:17.774169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:17.783411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.783865 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.784629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:17.785090 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:17.852572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:17.860327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-80bbba4e-8d96-4901-a285-3d12fbdad789 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1136 microversion: 2.1 time: 0.093884 Jun 24 10:39:17.860915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 230/458] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:17 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:18.234036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:18.235285 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:18.245787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.246469 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.247643 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.248309 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.412316 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:18.420396 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d14c4dcc-79ff-48b7-873c-c5cbed968453 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.193408 Jun 24 10:39:18.421008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 229/459] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:18 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:18.704596 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:18.707988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:18.714691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.715208 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.715978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.716494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.862764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:18.870950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-fe51db89-9cb7-44f2-8ad4-a350611feca0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.171827 Jun 24 10:39:18.871504 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 231/460] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:18 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:18.877380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:18.877954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:18.886630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.887360 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.888529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:18.889164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:18.954836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:18.962457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-20e65226-f418-4fde-8652-772bbc432ccb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1192 microversion: 2.1 time: 0.089051 Jun 24 10:39:18.962997 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 230/461] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:18 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:19.437909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:19.438587 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:19.444987 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.445548 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:19.446404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.446897 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:19.610679 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:19.619448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-76145017-84a3-4083-807f-4e039a9b2e4f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.185416 Jun 24 10:39:19.620015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 232/462] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:19 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:19.887526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:19.888142 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:19.899433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.899878 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:19.900651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.901122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:19.983777 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:19.984523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:19.991797 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.992235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:19.993026 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:19.993642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:20.225269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:20.233447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1b6677be-c601-4456-bdfc-6b53e5bd44f0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.349946 Jun 24 10:39:20.234288 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 231/463] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:19 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:20.265073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:20.275643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ce9078a4-cca3-403d-8941-d9ffc736c8ec tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.297328 Jun 24 10:39:20.276980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 233/464] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:19 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:20.637126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:20.637729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:20.646410 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:20.646850 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:20.647615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:20.648036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:20.863712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:20.871548 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6df89e24-57ca-44bd-87ba-b5839de85928 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.238321 Jun 24 10:39:20.872117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 232/465] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:20 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:21.011099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-01e00f73-9944-468d-a9e8-ca09d0371c33 req-d51c4764-96d5-4088-908d-c8e5b01c24d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef73619d-95e3-4358-a61b-7cbe58f76050", "tag": "f10fad00-dddc-4bae-9fce-5914b2b2b0ad"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:21.023666 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-01e00f73-9944-468d-a9e8-ca09d0371c33 req-d51c4764-96d5-4088-908d-c8e5b01c24d3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.024124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-01e00f73-9944-468d-a9e8-ca09d0371c33 req-d51c4764-96d5-4088-908d-c8e5b01c24d3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.040432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-01e00f73-9944-468d-a9e8-ca09d0371c33 req-d51c4764-96d5-4088-908d-c8e5b01c24d3 service nova] Creating event network-changed:f10fad00-dddc-4bae-9fce-5914b2b2b0ad for instance ef73619d-95e3-4358-a61b-7cbe58f76050 on hv-cinder-84753 Jun 24 10:39:21.047126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-01e00f73-9944-468d-a9e8-ca09d0371c33 req-d51c4764-96d5-4088-908d-c8e5b01c24d3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044995 Jun 24 10:39:21.048289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 234/466] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:21.252210 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:21.253038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:21.259620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.260058 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.261039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.261462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.295189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:21.295828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:21.307102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.307102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.307806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.308275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.536692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:21.545127 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-54e68157-7c0c-4f7d-bff3-52d29e78062d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.297075 Jun 24 10:39:21.545804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 233/467] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:21 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:21.562983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:21.578842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-622a621f-80d0-4056-ad66-370d6608145d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.287978 Jun 24 10:39:21.579443 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 235/468] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:21 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:21.891278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:21.891817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:21.899222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.899665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:21.900430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:21.900903 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:22.046179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:22.054694 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5b1a8f79-28b3-47bf-ab60-a007347610cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.169522 Jun 24 10:39:22.055404 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 234/469] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:21 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:22.564296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:22.565264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:22.575950 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:22.576721 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:22.577516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:22.578173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:22.599745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:22.600623 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:22.607387 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:22.607833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:22.608601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:22.609070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:22.776235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:22.786151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-766fb7ef-5359-419f-8e6a-e039f11394e3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.226139 Jun 24 10:39:22.786727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 236/470] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:22 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:22.790552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:22.798417 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d510af9f-db63-4140-be77-13f444b64d49 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.202731 Jun 24 10:39:22.798980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 235/471] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:22 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:23.079913 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:23.080892 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:23.087991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.088440 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.089243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.089675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.232049 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:23.240932 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f070dd90-b7f8-42d9-812f-00b1e6ca91c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.166630 Jun 24 10:39:23.241512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 237/472] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:23 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:23.803709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:23.804315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:23.811510 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.811949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.812712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.813172 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.815536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:23.816199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:23.823499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.823946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.824711 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:23.825256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:23.827945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:24.021395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:24.025018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:24.029799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e53cb0a8-38c1-4f57-9376-bbd423092fd2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.230431 Jun 24 10:39:24.030346 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 236/473] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:23 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:24.032687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2ba0e552-f40c-4e1f-a7d8-ec27abb1224f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.220907 Jun 24 10:39:24.033175 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 238/474] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:23 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:24.259811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:24.260602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:24.269197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:24.269791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:24.270791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:24.271364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:24.404279 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:24.405940 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=100 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:24.412698 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f93df9dd-f566-46ce-9cf7-5cfc66f84abc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.158004 Jun 24 10:39:24.413401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 237/475] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:24 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:25.048461 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:25.049106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:25.051280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:25.051960 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:25.056252 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.056981 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.057746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.058336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.058812 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.059253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.060038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.060463 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.329063 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:25.353490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:25.593310 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:25.600908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:25.601940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-41999596-c7ed-4f54-a666-15898555901f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.558306 Jun 24 10:39:25.602569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 239/476] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:25 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:25.608478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:25.609185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-98bf38ca-94c8-477b-af28-e3a8d18ced1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.562381 Jun 24 10:39:25.609622 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:25.615433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 238/477] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:25 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:25.615433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-552463477", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "networks": [{"uuid": "f971c2fc-6773-4a3f-b3f9-0aff8661b44d"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:25.622298 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.622772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.623535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:25.623972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:25.653518 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:25.670096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] validate_networks() for [('f971c2fc-6773-4a3f-b3f9-0aff8661b44d', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:39:25.839117 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:25.847459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-68ee0652-b9a7-40cd-9eb0-bf950194728b tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.243219 Jun 24 10:39:25.848215 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 240/478] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:25 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:26.074699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:39:26.075215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:39:26.075742 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:39:26.076342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:39:26.077001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:39:26.088482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.088983 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.089772 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.090205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.108389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Getting quotas for project b88db10e9091496a84e87446da50a3b6. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:39:26.112441 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Getting quotas for user 60367bf464f4441483bfe4a1373a1e92 and project b88db10e9091496a84e87446da50a3b6. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:39:26.123573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:39:26.125702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:39:26.173508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-54290557-7d39-4149-8ace-f42a1f57a745 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562187 Jun 24 10:39:26.174209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 239/479] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:39:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:39:26.184662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-79217b9e-64ca-4d6d-919e-d9cb5d2bdff8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:26.185425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-79217b9e-64ca-4d6d-919e-d9cb5d2bdff8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:26.243383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-79217b9e-64ca-4d6d-919e-d9cb5d2bdff8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:26.250529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-79217b9e-64ca-4d6d-919e-d9cb5d2bdff8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1218 microversion: 2.1 time: 0.069851 Jun 24 10:39:26.251760 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 241/480] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:26 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:26.620067 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:26.621464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:26.627244 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:26.627999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:26.630838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.631668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.633577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.634018 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.638756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.639509 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.640467 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.641345 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.836777 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:26.841089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:26.845995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d4cfa38e-829c-486e-a0a2-a0b41ce9db2a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.229971 Jun 24 10:39:26.846587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 240/481] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:26 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:26.849700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c9b45d84-4c91-42b8-b48e-e21b2ced4169 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.227149 Jun 24 10:39:26.850274 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 242/482] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:26 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:26.864350 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:26.865033 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:26.871390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.871833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:26.872579 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:26.873035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.001583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:27.009772 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4ba8ac41-c81d-435b-9758-4221db0714a6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.149330 Jun 24 10:39:27.010386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 241/483] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:26 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:27.267867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:27.269143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:27.276519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.277010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.277776 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.278254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.360516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:27.369089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7fbf2939-2ffa-49ec-945b-317942989087 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1288 microversion: 2.1 time: 0.105358 Jun 24 10:39:27.369832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 243/484] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:27 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:27.866649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:27.869419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:27.870409 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:27.872149 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:27.879884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.880418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.881215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.881660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.888176 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.888609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:27.889415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:27.889845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.154500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:28.162911 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-89ef435a-78bf-4071-bc3a-efc01c31c50d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.300174 Jun 24 10:39:28.163650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 244/485] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:27 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:28.168690 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:28.169395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:28.175977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:28.176503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.177227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:28.177440 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:28.177924 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.185541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ef8a8015-ba4d-49d5-8682-cedb45ae3db0 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.325860 Jun 24 10:39:28.186348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 242/486] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:27 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:28.387258 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:28.388066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:28.394577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:28.395010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.395969 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:28.396418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.414579 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:28.422570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-bb6cac3a-bdf1-4552-88ef-a6f081e8cc22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1677 microversion: 2.1 time: 0.257845 Jun 24 10:39:28.432230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 245/487] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:28 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:28.579566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:28.587375 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-93fc6ceb-7a4f-4aee-9954-1b317fa52bf8 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.204022 Jun 24 10:39:28.587946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 243/488] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:28 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:28.845342 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-ba8cb74f-eda8-4cd1-a4da-67fa9cbbd901 req-f3b8342d-3c70-4e6f-9641-f1abfd5a5552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101506ea-7abb-467d-b385-9fde866462a3", "tag": "3002100f-f2f1-4785-b6e8-359e85ff5114"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:28.858475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ba8cb74f-eda8-4cd1-a4da-67fa9cbbd901 req-f3b8342d-3c70-4e6f-9641-f1abfd5a5552 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:28.859099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ba8cb74f-eda8-4cd1-a4da-67fa9cbbd901 req-f3b8342d-3c70-4e6f-9641-f1abfd5a5552 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:28.871533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-ba8cb74f-eda8-4cd1-a4da-67fa9cbbd901 req-f3b8342d-3c70-4e6f-9641-f1abfd5a5552 service nova] Creating event network-changed:3002100f-f2f1-4785-b6e8-359e85ff5114 for instance 101506ea-7abb-467d-b385-9fde866462a3 on hv-cinder-84753 Jun 24 10:39:28.876986 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-ba8cb74f-eda8-4cd1-a4da-67fa9cbbd901 req-f3b8342d-3c70-4e6f-9641-f1abfd5a5552 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Jun 24 10:39:28.877583 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 246/489] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:29.180011 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:29.180613 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:29.187888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.188379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.189206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.189655 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.203537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:29.204280 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:29.210935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.211377 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.212138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.212571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.461878 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:29.469965 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4b2da8d3-236d-4627-bf95-95214341ff10 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.293952 Jun 24 10:39:29.472954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 244/490] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:29 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:29.473676 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:29.477907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:29.478510 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:29.485310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.485754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.486027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ebeaea32-4d62-4d38-af4a-13bfc41924a2 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.286570 Jun 24 10:39:29.486514 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.486649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 247/491] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:29 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:29.486939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.605692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:29.606229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:29.612597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.613872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.614675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.615211 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.629709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:29.637575 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ac2c2111-c0a9-46ba-a7e6-39a4ccf49352 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1654 microversion: 2.1 time: 0.163368 Jun 24 10:39:29.638154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 245/492] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:29 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:29.654580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-055536c5-e278-48a1-ad64-0703ec4e2986 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:29.661796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-055536c5-e278-48a1-ad64-0703ec4e2986 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.662246 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-055536c5-e278-48a1-ad64-0703ec4e2986 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.725287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-055536c5-e278-48a1-ad64-0703ec4e2986 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Going to try to start instance {{(pid=124304) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:39:29.754988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:29.762839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5168ccf1-c895-4ed8-a419-ef91110737d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.161282 Jun 24 10:39:29.763401 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 248/493] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:29 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:29.773856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-055536c5-e278-48a1-ad64-0703ec4e2986 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action" status: 202 len: 0 microversion: 2.1 time: 0.122881 Jun 24 10:39:29.774502 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 246/494] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:39:29 2022] POST /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:39:29.782997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:29.783613 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:29.789893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.790339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.791097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:29.791533 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:29.922872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:29.932723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-906e4fea-9f58-4014-8c1d-08edadf8e957 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1663 microversion: 2.1 time: 0.153686 Jun 24 10:39:29.933331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 249/495] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:29 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:30.488253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:30.489102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:30.491251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:30.497629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.498073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.498832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.499270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.505935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:30.506914 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:30.514376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.514843 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.515682 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.516129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.703671 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:30.707439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:30.712022 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4e6c13b4-be0f-430e-b000-662d063eb259 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.228602 Jun 24 10:39:30.712528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 247/496] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:30 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:30.715969 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b916c701-e5fe-49f9-9f21-08f092dadaf8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.215345 Jun 24 10:39:30.716623 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 250/497] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:30 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:30.783920 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:30.784949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:30.795400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.796135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.797446 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.798156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.937984 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:30.946050 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cc96c9c3-cd5a-43ab-b3d2-fa5e9ee8255e tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.168431 Jun 24 10:39:30.946617 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 248/498] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:30 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:30.949743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:30.950352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:30.957659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.958110 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:30.959284 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:30.959883 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:31.098398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:31.105992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3621fdb0-07bf-44c7-ac07-3f95019693ff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1663 microversion: 2.1 time: 0.160149 Jun 24 10:39:31.106575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 251/499] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:30 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:31.730427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:31.731219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:31.734184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:31.734868 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:31.738623 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:31.739036 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:31.739882 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:31.740442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:31.742214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:31.742691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:31.743454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:31.743886 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:32.035646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:32.042750 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:32.044924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-13ba65bc-6a81-49c8-be4c-17571de9d29e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.318565 Jun 24 10:39:32.051532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cbb2cb50-6308-4e34-971e-d66348f85938 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.321744 Jun 24 10:39:32.052105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 252/500] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:31 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:32.055059 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 249/501] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:31 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:32.057677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:32.058424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:32.064557 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:32.065328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:32.066092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:32.066550 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:32.123370 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:32.123972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:32.130212 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:32.130656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:32.131411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:32.131841 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:32.234180 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:32.242089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5b2f2c29-be27-4562-904b-e212e0cf2046 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.188475 Jun 24 10:39:32.242674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 253/502] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:32 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:32.557111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:32.564857 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b51b4a61-536d-4149-b3e2-62457aa24463 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1663 microversion: 2.1 time: 0.445295 Jun 24 10:39:32.565551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 250/503] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:32 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1663 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:33.061722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:33.063803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:33.069079 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:33.070300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:33.071653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.072457 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.073303 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.074167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.077434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.078118 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.078884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.079312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.282076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:33.285223 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:33.291078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-45269f6e-f533-4d8b-b50f-ec71a23e6e66 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.233211 Jun 24 10:39:33.291874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 254/504] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:33 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:33.293547 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9df3089f-a8a9-4d5b-a651-782661993747 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1737 microversion: 2.1 time: 0.228347 Jun 24 10:39:33.294109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 251/505] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:33 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:33.296569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:33.297243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:33.304680 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.305169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.305949 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.306384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.441551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:33.449209 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a3fe58ee-4597-41ce-a887-7c57e701a039 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.156133 Jun 24 10:39:33.449963 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 255/506] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:33 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:33.586835 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:33.587461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:33.594658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.595129 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.595911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:33.596361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:33.739185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:33.749690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4f303fb2-fad0-4f5d-a9ce-4a2717038790 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1663 microversion: 2.1 time: 0.168963 Jun 24 10:39:33.750273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 252/507] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:33 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:34.308989 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.309714 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.310471 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.311605 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.316398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.316895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.317681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.318120 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.321293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.321815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.322769 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.323274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.333961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=100 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:34.533844 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:34.536888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:34.543685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7798d665-52bb-4ba9-831b-e728803b5b1d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.238843 Jun 24 10:39:34.544279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 256/508] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:34 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:34.545163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-141b943c-9e8d-48b0-9968-6fa90704b607 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1717 microversion: 2.1 time: 0.238988 Jun 24 10:39:34.546023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 253/509] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:34 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1717 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:34.549512 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.550137 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.556489 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.556988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.557751 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.558158 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.654763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.655269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.661438 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.661896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.662662 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.663094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.667116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:34.698551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:34.706297 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0529cd01-97d1-40b5-b93c-424d555c04b5 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.160770 Jun 24 10:39:34.706873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 257/510] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:34 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:34.744581 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] HTTP exception thrown: Cannot 'detach_volume' instance 6456f179-5c11-462c-920a-a8939662cdde while it is in vm_state rescued Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Request method failure captured: Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments/c5312f43-3355-4ad8-a35a-67ff5dd12987 HTTP/1.1 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-gToLcv_Sslb-xAViBn5WFYlOn0CANhAFQgPBFr4cZReX6DxYRmi1nOG8IVpkxzFjShoHKF6T5U_OTbYFRSOsV7fljzYxlSLN0CRHQglHZKz9nmBmYZqF-1kfZZL7PbZ18jFOjVaYKD7AnIvya4F7qCFsoLnPvAugqr_6vJ39pT0 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:39:34.746270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8cc166ec03349b3b2b0d69840886bd9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 960b18fe180f4185b291da1d9c18a2fa Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:39:34.747885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Cannot 'detach_volume' instance 6456f179-5c11-462c-920a-a8939662cdde while it is in vm_state rescued Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'server_id': '6456f179-5c11-462c-920a-a8939662cdde', 'id': 'c5312f43-3355-4ad8-a35a-67ff5dd12987'} Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6456f179-5c11-462c-920a-a8939662cdde in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:39:34.751942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6456f179-5c11-462c-920a-a8939662cdde while it is in vm_state rescued Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6456f179-5c11-462c-920a-a8939662cdde while it is in vm_state rescued Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:39:34.753238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Returning 409 to user: Cannot 'detach_volume' instance 6456f179-5c11-462c-920a-a8939662cdde while it is in vm_state rescued {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:39:34.754261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8e5dde6e-4467-42f8-a024-d1aeb704280d tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments/c5312f43-3355-4ad8-a35a-67ff5dd12987" status: 409 len: 152 microversion: 2.1 time: 0.097522 Jun 24 10:39:34.754261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 254/511] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:39:34 2022] DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments/c5312f43-3355-4ad8-a35a-67ff5dd12987 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 24 10:39:34.756797 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:34.757376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.763778 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.764226 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.765010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.765441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.767257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.767841 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.774923 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.775364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.776173 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.776604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.842935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6951df98-b3bc-4c86-9420-82596f58ecff tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/action" status: 202 len: 0 microversion: 2.1 time: 0.089444 Jun 24 10:39:34.844229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 258/512] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:39:34 2022] POST /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:39:34.862102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:34.864550 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:34.868720 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:34.895046 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.895494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:34.897611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:34.898124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:35.023458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:35.037614 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fc8dd4a4-aa76-49c7-b8d4-73e173530e65 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1667 microversion: 2.1 time: 0.273819 Jun 24 10:39:35.038415 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 255/513] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:34 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1667 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:35.148256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:35.157547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-01567f39-8cc0-4d4d-a4eb-b3d54d8b5b00 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1725 microversion: 2.1 time: 0.308943 Jun 24 10:39:35.158126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 259/514] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:34 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:35.561020 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:35.561611 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:35.568492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:35.568985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:35.569748 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:35.570177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:35.723460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:35.724302 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:35.734112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:35.735597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:35.736726 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:35.737643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:35.835011 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:35.843529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a41e0d87-33b1-4d2f-8fe2-d46a1be31e5b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.286472 Jun 24 10:39:35.844241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 256/515] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:35 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:35.910716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:35.918065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-35efa868-3983-4c80-87e6-77503966ea66 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.198758 Jun 24 10:39:35.918660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 260/516] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:35 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:36.175095 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:36.175764 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:36.177866 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.178375 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.183865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.184306 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.185103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.185519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.320417 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:36.330484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-79e84572-8521-4e3a-b6da-0ab3ff5d004b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1725 microversion: 2.1 time: 0.159285 Jun 24 10:39:36.331270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 257/517] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:36 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:36.680406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-b2b3817b-6986-4a7c-99a8-fba354a308a2 req-ddfa5a24-8f01-40b8-9d67-1d3ae64fa2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef73619d-95e3-4358-a61b-7cbe58f76050", "name": "network-vif-plugged", "status": "completed", "tag": "f10fad00-dddc-4bae-9fce-5914b2b2b0ad"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:36.685482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:36.693200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-b2b3817b-6986-4a7c-99a8-fba354a308a2 req-ddfa5a24-8f01-40b8-9d67-1d3ae64fa2d2 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.693678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-b2b3817b-6986-4a7c-99a8-fba354a308a2 req-ddfa5a24-8f01-40b8-9d67-1d3ae64fa2d2 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.706644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-b2b3817b-6986-4a7c-99a8-fba354a308a2 req-ddfa5a24-8f01-40b8-9d67-1d3ae64fa2d2 service nova] Creating event network-vif-plugged:f10fad00-dddc-4bae-9fce-5914b2b2b0ad for instance ef73619d-95e3-4358-a61b-7cbe58f76050 on hv-cinder-84753 Jun 24 10:39:36.711895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-b2b3817b-6986-4a7c-99a8-fba354a308a2 req-ddfa5a24-8f01-40b8-9d67-1d3ae64fa2d2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 Jun 24 10:39:36.712506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 261/518] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:36.860422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:36.861555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:36.869477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.869947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.871005 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.871740 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.935051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:36.935537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:36.943232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.943681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:36.944442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:36.951766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:37.054083 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:37.062438 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-025a4447-b54b-4cce-9811-bab682051747 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.206546 Jun 24 10:39:37.068897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 258/519] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:36 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:37.111390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:37.118874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-32e4182a-de7c-411e-8894-c2b062da6f7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.188355 Jun 24 10:39:37.119624 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 262/520] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:36 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:37.348380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:37.349010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:37.355516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:37.355970 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:37.356761 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:37.357195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:37.537077 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:37.546704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a57a1b91-2f0b-4fe6-b64d-4153ca8de84b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1725 microversion: 2.1 time: 0.202500 Jun 24 10:39:37.547357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 259/521] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:37 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:38.083590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:38.085145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:38.094920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.095979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.097047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.097636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.137531 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:38.138844 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:38.149240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.150888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.153092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.154464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.416925 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:38.424339 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:38.424591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0d2cc1a8-bdb9-4abc-9f49-f5dfa0ff7842 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.348432 Jun 24 10:39:38.433452 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8727f0c9-3e1c-4ced-b225-e71f02569a2f tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.301800 Jun 24 10:39:38.434609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 263/522] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:38 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:38.443571 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 260/523] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:38 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:39:38.564068 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:38.565029 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:38.572217 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.572764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.573620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.574059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.725521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:38.734792 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a6a82d63-bbd5-4686-a68c-fc2cc557e984 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1731 microversion: 2.1 time: 0.174850 Jun 24 10:39:38.735242 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 264/524] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:38 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:38.744699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-dda48340-686f-4a29-b06f-e011a6377685 req-8550398b-9e3a-4100-a405-fae0b9bb4e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101506ea-7abb-467d-b385-9fde866462a3", "name": "network-vif-plugged", "status": "completed", "tag": "3002100f-f2f1-4785-b6e8-359e85ff5114"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:38.751122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:38.751820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:38.753003 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-dda48340-686f-4a29-b06f-e011a6377685 req-8550398b-9e3a-4100-a405-fae0b9bb4e57 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.753440 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-dda48340-686f-4a29-b06f-e011a6377685 req-8550398b-9e3a-4100-a405-fae0b9bb4e57 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.758030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.758571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.759507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:38.759942 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:38.764851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-dda48340-686f-4a29-b06f-e011a6377685 req-8550398b-9e3a-4100-a405-fae0b9bb4e57 service nova] Creating event network-vif-plugged:3002100f-f2f1-4785-b6e8-359e85ff5114 for instance 101506ea-7abb-467d-b385-9fde866462a3 on hv-cinder-84753 Jun 24 10:39:38.770572 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-dda48340-686f-4a29-b06f-e011a6377685 req-8550398b-9e3a-4100-a405-fae0b9bb4e57 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029500 Jun 24 10:39:38.771184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 261/525] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:38.840785 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b5758315-9e17-4416-957c-5cd631315b89 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093195 Jun 24 10:39:38.841103 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 265/526] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:39:38 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:39:39.442172 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:39.443669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:39.450827 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:39.451310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:39.451449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:39.451991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:39.452177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:39.452428 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:39.463506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:39.463941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:39.464718 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:39.465202 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:39.979614 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:39.987985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-79e30de3-03ae-449a-8f54-47bed8a1cabf tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1266 microversion: 2.1 time: 0.550513 Jun 24 10:39:39.988537 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 262/527] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:39 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1266 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:40.030780 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:40.038363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-20f8483e-90c5-4e8a-8e2a-fb4e2625cd37 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.591641 Jun 24 10:39:40.038944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 266/528] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:39 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:40.393658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-8bb6f205-f85e-4585-b5af-679ad5dcefe4 req-4f2b4f71-cac1-4879-88c8-f51e6216eab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:40.402356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8bb6f205-f85e-4585-b5af-679ad5dcefe4 req-4f2b4f71-cac1-4879-88c8-f51e6216eab0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:40.403031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8bb6f205-f85e-4585-b5af-679ad5dcefe4 req-4f2b4f71-cac1-4879-88c8-f51e6216eab0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:40.414572 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-8bb6f205-f85e-4585-b5af-679ad5dcefe4 req-4f2b4f71-cac1-4879-88c8-f51e6216eab0 service nova] Creating event network-changed:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:39:40.421334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-8bb6f205-f85e-4585-b5af-679ad5dcefe4 req-4f2b4f71-cac1-4879-88c8-f51e6216eab0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031270 Jun 24 10:39:40.421972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 263/529] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:41.005536 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:41.006119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:41.012767 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.013245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.013998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.014396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.056063 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:41.056969 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:41.064968 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.065515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.066366 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.066871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.207322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:41.216390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-22c07365-0ad6-49ca-ad47-bdb417af99c6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1454 microversion: 2.1 time: 0.214990 Jun 24 10:39:41.217322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 267/530] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:41 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:41.234643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:41.235361 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:41.236000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:41.243372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.243938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fe2191ac-4424-430e-a3b5-5667b690f072 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.191909 Jun 24 10:39:41.244132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.248787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 264/531] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:41 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:41.249266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:41.249266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:41.384066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:41.391634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cc41a4d9-d379-4ddd-b5e5-c0a753b6b559 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1454 microversion: 2.1 time: 0.162558 Jun 24 10:39:41.392204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 268/532] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:41 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:42.260960 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:42.261490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:42.268333 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:42.268796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:42.269553 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:42.269976 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:42.406327 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:42.414152 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-dfafd002-adeb-4b38-bd38-aad7b58ec7d2 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.157752 Jun 24 10:39:42.414739 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 265/533] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:42 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:42.435391 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-0f590de5-b677-4ecb-8249-fe9394e7e0e2 req-68f76625-6ba0-43b8-b222-a7a2f1dddcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:42.445273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-0f590de5-b677-4ecb-8249-fe9394e7e0e2 req-68f76625-6ba0-43b8-b222-a7a2f1dddcd1 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:42.445707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-0f590de5-b677-4ecb-8249-fe9394e7e0e2 req-68f76625-6ba0-43b8-b222-a7a2f1dddcd1 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:42.457882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-0f590de5-b677-4ecb-8249-fe9394e7e0e2 req-68f76625-6ba0-43b8-b222-a7a2f1dddcd1 service nova] Creating event network-changed:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:39:42.463273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-0f590de5-b677-4ecb-8249-fe9394e7e0e2 req-68f76625-6ba0-43b8-b222-a7a2f1dddcd1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Jun 24 10:39:42.464137 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 269/534] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:43.187478 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-6554c61e-e021-4d6c-ab90-506f25fdaa33 req-28a64ef7-c8f7-453f-adbd-f002ff8479bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef73619d-95e3-4358-a61b-7cbe58f76050", "tag": "f10fad00-dddc-4bae-9fce-5914b2b2b0ad"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:43.196445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6554c61e-e021-4d6c-ab90-506f25fdaa33 req-28a64ef7-c8f7-453f-adbd-f002ff8479bd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:43.197045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6554c61e-e021-4d6c-ab90-506f25fdaa33 req-28a64ef7-c8f7-453f-adbd-f002ff8479bd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:43.208861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-6554c61e-e021-4d6c-ab90-506f25fdaa33 req-28a64ef7-c8f7-453f-adbd-f002ff8479bd service nova] Creating event network-changed:f10fad00-dddc-4bae-9fce-5914b2b2b0ad for instance ef73619d-95e3-4358-a61b-7cbe58f76050 on hv-cinder-84753 Jun 24 10:39:43.214241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-6554c61e-e021-4d6c-ab90-506f25fdaa33 req-28a64ef7-c8f7-453f-adbd-f002ff8479bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030508 Jun 24 10:39:43.215785 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 266/535] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:43.431766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:43.432537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:43.441235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:43.442479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:43.443624 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:43.444428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:43.591033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:43.599095 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-20681999-cead-4e86-84d0-ae4fc178350a tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1318 microversion: 2.1 time: 0.171564 Jun 24 10:39:43.599679 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 270/536] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:43 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:44.618818 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:44.619657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:44.626435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:44.626873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:44.627628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:44.628040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:44.846497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:39:44.856629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-144d97d3-d1e5-4fbe-9599-06ae088cddf6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1506 microversion: 2.1 time: 0.242906 Jun 24 10:39:44.857451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 267/537] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:39:44 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:39:44.877863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80be8a65-8dbc-4efc-9168-829e7a4d8d98", "device": "/dev/sdb"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:39:44.879460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:44.886405 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:44.886887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:44.887652 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:44.888053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:45.153007 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1df39345-8466-4c04-a573-ef3d635ccbc1 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "POST /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278513 Jun 24 10:39:45.153639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 271/538] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:39:44 2022] POST /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:39:56.169051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:56.169770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:56.172137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=41 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.173194 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=71 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.179075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.179519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.180280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.180708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.209862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fd7c9889-22cd-4c23-8cc6-8489c0d70af5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments/de5374cb-37c4-48ff-8703-f71e41649f64" status: 200 len: 194 microversion: 2.20 time: 0.045424 Jun 24 10:39:56.210474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 268/539] 10.222.0.69 () {60 vars in 1453 bytes} [Fri Jun 24 10:39:56 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments/de5374cb-37c4-48ff-8703-f71e41649f64 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:39:56.272871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:56.273425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:56.276255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=25 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.276985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:56.283412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.283867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.284644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.285079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.373242 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lazy-loading 'services' on Instance uuid 2d906fe1-2729-458e-8564-c4ba21b2767a {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:39:56.449444 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-dd8b6526-aac0-4c57-8682-8a251491ad7a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments/de5374cb-37c4-48ff-8703-f71e41649f64" status: 202 len: 0 microversion: 2.20 time: 0.180856 Jun 24 10:39:56.450071 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 272/540] 10.222.0.69 () {60 vars in 1456 bytes} [Fri Jun 24 10:39:56 2022] DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments/de5374cb-37c4-48ff-8703-f71e41649f64 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:39:56.459364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:56.460728 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:56.467111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.468003 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.468970 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:56.469445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:56.500558 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9834ef58-8386-429b-9b00-2c84170cc5ca tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045444 Jun 24 10:39:56.501574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 269/541] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:39:56 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:39:57.514487 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:57.515584 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:57.522205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:57.522641 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:57.523401 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:57.523838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:57.558153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-493bf54f-0321-4d1a-88b7-2acb122ce7ed tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048544 Jun 24 10:39:57.558723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 273/542] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:39:57 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:39:58.574615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:58.576089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:58.587231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:58.587966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:58.589283 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:58.589997 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:58.621453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fc5c2480-2922-4d54-ac12-6ece2671468a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053573 Jun 24 10:39:58.622014 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 270/543] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:39:58 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:39:59.638407 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:39:59.639884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:39:59.648072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:59.648516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:59.649307 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:39:59.649735 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:39:59.680844 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7242dc6c-8b92-4f30-ab22-80d722bdb212 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049620 Jun 24 10:39:59.681403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 274/544] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:39:59 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:40:00.695916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:00.697026 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:00.704991 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.705519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:00.706457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.706936 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:00.738755 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-72d55cbb-0cee-41b8-ac41-27705971cb84 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047968 Jun 24 10:40:00.739231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 271/545] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:40:00 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:00.803483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:00.804091 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:00.814422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.815116 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:00.816172 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.816610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:00.842103 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:00.928470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-63f1f51f-ab71-4369-b50a-ea463172344d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 204 len: 0 microversion: 2.20 time: 0.130926 Jun 24 10:40:00.929145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 275/546] 10.222.0.69 () {60 vars in 1279 bytes} [Fri Jun 24 10:40:00 2022] DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:40:00.937858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:00.938465 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:00.945236 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.945688 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:00.946448 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:00.946884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:01.083506 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:01.092147 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:01.094023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:01.095192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cb93b30f-c8c5-4cfa-862f-f3723c86e4f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.161232 Jun 24 10:40:01.095766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 272/547] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:00 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:02.119629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:02.120814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:02.131816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:02.132265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:02.133076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:02.133780 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:02.280970 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:02.291177 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:02.293575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:02.295210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9c5edb46-7458-4ea1-a4c1-80cac206f45c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.183069 Jun 24 10:40:02.296037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 276/548] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:02 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:03.319695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:03.320429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:03.327565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:03.328009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:03.328875 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:03.329301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:03.813818 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:03.822184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:03.823680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:03.824922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ff791692-4036-4e77-a9db-a0c3113f72e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1722 microversion: 2.20 time: 0.509299 Jun 24 10:40:03.825529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 273/549] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:03 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:04.264280 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-5b9579b4-3d12-4068-b794-5ed8d7c51a28 req-e4dc3a71-d977-43e5-9dd1-401a8e8d37f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d906fe1-2729-458e-8564-c4ba21b2767a", "name": "network-vif-deleted", "tag": "bcb7370e-287a-4f51-9b23-0add5505f560"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:04.275210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-5b9579b4-3d12-4068-b794-5ed8d7c51a28 req-e4dc3a71-d977-43e5-9dd1-401a8e8d37f1 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.275655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-5b9579b4-3d12-4068-b794-5ed8d7c51a28 req-e4dc3a71-d977-43e5-9dd1-401a8e8d37f1 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.298334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-5b9579b4-3d12-4068-b794-5ed8d7c51a28 req-e4dc3a71-d977-43e5-9dd1-401a8e8d37f1 service nova] Creating event network-vif-deleted:bcb7370e-287a-4f51-9b23-0add5505f560 for instance 2d906fe1-2729-458e-8564-c4ba21b2767a on hv-cinder-84753 Jun 24 10:40:04.304105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-5b9579b4-3d12-4068-b794-5ed8d7c51a28 req-e4dc3a71-d977-43e5-9dd1-401a8e8d37f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043576 Jun 24 10:40:04.305119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 277/550] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:04.619602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:04.620676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:04.627758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.628196 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.628970 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.629377 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.721378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lazy-loading 'services' on Instance uuid 101506ea-7abb-467d-b385-9fde866462a3 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:40:04.814258 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fd3f87c8-f9b1-4802-bf87-cdc07b291ac4 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "DELETE /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3/os-volume_attachments/80be8a65-8dbc-4efc-9168-829e7a4d8d98" status: 202 len: 0 microversion: 2.1 time: 0.198380 Jun 24 10:40:04.815618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 274/551] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:40:04 2022] DELETE /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3/os-volume_attachments/80be8a65-8dbc-4efc-9168-829e7a4d8d98 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:40:04.844798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:04.845618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:04.856599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.857083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.862781 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.863478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.929911 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:04.934437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:04.935855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lazy-loading 'fault' on Instance uuid 2d906fe1-2729-458e-8564-c4ba21b2767a {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:40:04.983012 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:04.990721 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:04.995468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:04.996929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-72df07ea-d176-47b8-a18e-52c651c4bd3a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 200 len: 1371 microversion: 2.20 time: 0.156870 Jun 24 10:40:04.997499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 278/552] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:04 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:05.967124 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:05.967724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:05.976686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:05.977159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:05.977931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:05.978362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:06.003355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:06.015000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:06.015789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:06.022702 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:06.023186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:06.023955 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:06.024384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:06.040796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a HTTP/1.1 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:40:06.042564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:40:06.044159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '2d906fe1-2729-458e-8564-c4ba21b2767a'} Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:06.045439 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:40:06.046801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:06.048160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:06.048160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b9483be1-f8e5-4d1f-ba43-fba78a236726 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 404 len: 111 microversion: 2.20 time: 0.032964 Jun 24 10:40:06.048160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 279/553] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:06 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:40:06.052793 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b44c3a22-8313-4dd9-85c8-3b7a4b8bd046 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '.version_select at 0x7f17629dbaf0>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:06.075583 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b44c3a22-8313-4dd9-85c8-3b7a4b8bd046 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146620408" status: 204 len: 0 microversion: 2.20 time: 0.026313 Jun 24 10:40:06.076300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 280/554] 10.222.0.69 () {60 vars in 1261 bytes} [Fri Jun 24 10:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146620408 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 10:40:06.094534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-93301c53-55ad-4e42-8727-34dbd5daf098 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "DELETE /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 204 len: 0 microversion: 2.1 time: 0.134282 Jun 24 10:40:06.095411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 275/555] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:40:05 2022] DELETE /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:06.103574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:06.104184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:06.110999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:06.111448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:06.112210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:06.112642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:06.265507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:06.274097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-af9d1996-c1fa-4852-8fa6-1076961c72c6 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1512 microversion: 2.1 time: 0.174382 Jun 24 10:40:06.274971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 281/556] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:06 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:06.761023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3cdd4c2b-5a42-44f5-8bed-baada71394a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: .version_select at 0x7f1763d23ee0>, body: {"keypair": {"name": "tempest-keypair-1259635867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISlh2/SlypX02UNKxy9BF3Zu5THJS9b/QFI4w0LyfEaQg+quOfB8Adx1IEIskntHj3aChh7bmU9/VcVP28aaCFRy6nPgxZJbx2tI/VOb7iBilmKUkGagYYbqNQSAVdACQ=="}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:06.776376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-3cdd4c2b-5a42-44f5-8bed-baada71394a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for project 281651371cba4d4a9454b0747947cc83. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:40:06.780598 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-3cdd4c2b-5a42-44f5-8bed-baada71394a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for user 3e4ed08c1c81453abaa6c1dd826f0258 and project 281651371cba4d4a9454b0747947cc83. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:40:06.805246 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3cdd4c2b-5a42-44f5-8bed-baada71394a2 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048469 Jun 24 10:40:06.805834 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 276/557] 10.222.0.69 () {62 vars in 1199 bytes} [Fri Jun 24 10:40:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 10:40:07.292294 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:07.294047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:07.301133 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:07.301606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:07.302758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:07.303165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:07.512176 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:07.519852 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d439b1c2-e41f-4751-8805-170782a20d7b tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1512 microversion: 2.1 time: 0.232089 Jun 24 10:40:07.521243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 282/558] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:07 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:08.403695 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1673744699", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c54d8b2-277b-49d0-99b7-bf6f64432c4a"}], "security_groups": [{"name": "tempest-securitygroup--1486478278"}], "key_name": "tempest-keypair-1259635867", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:08.537730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:08.539022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:08.546109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:08.546563 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:08.547364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:08.547780 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:08.555583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] validate_networks() for [('5c54d8b2-277b-49d0-99b7-bf6f64432c4a', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:40:08.673603 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60367bf464f4441483bfe4a1373a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88db10e9091496a84e87446da50a3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:08.685365 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f2d732db-d7fc-4a0b-ba30-93c2deaf0f46 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 200 len: 1470 microversion: 2.1 time: 0.151991 Jun 24 10:40:08.686033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 283/559] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:08 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:08.701595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-81e19d71-ce67-4dd6-8f76-e01d857df10a req-24b5c854-06ed-48ac-b16e-f0c7b586111a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101506ea-7abb-467d-b385-9fde866462a3", "name": "network-vif-deleted", "tag": "3002100f-f2f1-4785-b6e8-359e85ff5114"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:08.712629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-81e19d71-ce67-4dd6-8f76-e01d857df10a req-24b5c854-06ed-48ac-b16e-f0c7b586111a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:08.713244 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-81e19d71-ce67-4dd6-8f76-e01d857df10a req-24b5c854-06ed-48ac-b16e-f0c7b586111a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:08.725444 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-81e19d71-ce67-4dd6-8f76-e01d857df10a req-24b5c854-06ed-48ac-b16e-f0c7b586111a service nova] Creating event network-vif-deleted:3002100f-f2f1-4785-b6e8-359e85ff5114 for instance 101506ea-7abb-467d-b385-9fde866462a3 on hv-cinder-84753 Jun 24 10:40:08.730248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-81e19d71-ce67-4dd6-8f76-e01d857df10a req-24b5c854-06ed-48ac-b16e-f0c7b586111a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Jun 24 10:40:08.730939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 284/560] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:09.013566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:40:09.013989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:40:09.014457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:40:09.014859 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:40:09.015287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:40:09.026812 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:09.027269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:09.028313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:09.028967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:09.048216 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for project 281651371cba4d4a9454b0747947cc83. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:40:09.052721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Getting quotas for user 3e4ed08c1c81453abaa6c1dd826f0258 and project 281651371cba4d4a9454b0747947cc83. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:40:09.065216 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:40:09.067740 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:40:09.118844 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6e94b39e-7905-4a0a-adc7-3f3f241c7849 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.719936 Jun 24 10:40:09.119541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 277/561] 10.222.0.69 () {62 vars in 1187 bytes} [Fri Jun 24 10:40:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 10:40:09.132611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:09.133383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:09.202236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:09.209782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:09.211308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:09.212620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-72fc6d96-e521-457e-a0d1-3ee66fc1ffd6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1282 microversion: 2.20 time: 0.086194 Jun 24 10:40:09.213219 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 285/562] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:09 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:40:09.704270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:09.704892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] [instance: 101506ea-7abb-467d-b385-9fde866462a3] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:09.712216 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:09.712682 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:09.713456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:09.713891 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:09.728132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] HTTP exception thrown: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Request method failure captured: Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 HTTP/1.1 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZPtYY_XcO6_NVRV8dZopl2H4p7Aus0-2U2TAyKpt3bjcCb6PNCNgVPyrqG0vN1TO5Lqi6oZDBzxmP26sR4C0M4ZmbrPFIjMm3YyC6TehszwA7yFidq9lCAujbWc_dOjUxXRjqebN48SKPJJG9EggFdteKCSYAcFDlsBUkfrNPtVw78 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: b88db10e9091496a84e87446da50a3b6 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:40:09.729817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_b88db10e9091496a84e87446da50a3b6", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/b88db10e9091496a84e87446da50a3b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: b88db10e9091496a84e87446da50a3b6 Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-710481972 Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesSnapshotTestJSON-710481972-project Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 60367bf464f4441483bfe4a1373a1e92 Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesSnapshotTestJSON-710481972-project Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. Jun 24 10:40:09.731420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '101506ea-7abb-467d-b385-9fde866462a3'} Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:09.732280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. Jun 24 10:40:09.733608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:09.734800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] Returning 404 to user: Instance 101506ea-7abb-467d-b385-9fde866462a3 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:09.734800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2d8ded9a-8715-43a0-9f70-d3e499efb667 tempest-VolumesSnapshotTestJSON-710481972 tempest-VolumesSnapshotTestJSON-710481972-project] 10.222.0.69 "GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3" status: 404 len: 111 microversion: 2.1 time: 0.031435 Jun 24 10:40:09.734800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 278/563] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:09 2022] GET /compute/v2.1/servers/101506ea-7abb-467d-b385-9fde866462a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:40:10.231180 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:10.232457 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:10.240875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:10.242334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:10.243283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:10.243879 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:10.324859 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:10.334366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:10.336149 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:10.337497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-408f623b-8445-4e28-a952-b102260aebe9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1352 microversion: 2.20 time: 0.110381 Jun 24 10:40:10.338191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 286/564] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:10 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:11.357336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:11.357885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:11.364714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:11.365266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:11.366089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:11.366516 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:11.607904 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:11.616645 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:11.618450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:11.619564 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-90bbb0eb-02d8-4790-bee5-da91c85e2f89 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.266434 Jun 24 10:40:11.620117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 279/565] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:11 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:11.767648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-14f9a3db-a725-457c-beab-90d6d483aa75 req-c333bfcf-977c-4a47-bb21-826205483ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:11.778615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-14f9a3db-a725-457c-beab-90d6d483aa75 req-c333bfcf-977c-4a47-bb21-826205483ad0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:11.779203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-14f9a3db-a725-457c-beab-90d6d483aa75 req-c333bfcf-977c-4a47-bb21-826205483ad0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:11.792687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-14f9a3db-a725-457c-beab-90d6d483aa75 req-c333bfcf-977c-4a47-bb21-826205483ad0 service nova] Creating event network-changed:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:40:11.797782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-14f9a3db-a725-457c-beab-90d6d483aa75 req-c333bfcf-977c-4a47-bb21-826205483ad0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034840 Jun 24 10:40:11.798593 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 287/566] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:12.642164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:12.643163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:12.654215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:12.654937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:12.656171 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:12.656926 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:12.794833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:12.806555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:12.808017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:12.809151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-78bfa3f6-484c-4c10-b68f-bf7938984d7d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.173598 Jun 24 10:40:12.809877 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 280/567] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:12 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:13.833699 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:13.834400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:13.841051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:13.841506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:13.842260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:13.842687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:13.974894 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:13.982881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:13.984364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:13.985507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-386ecc42-757b-4dc7-a54d-0926b80c37ac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.160022 Jun 24 10:40:13.986072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 288/568] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:13 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:15.007719 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:15.008641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:15.019890 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:15.020627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:15.022079 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:15.022760 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:15.186594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:15.196725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:15.198395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:15.199512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ec24f239-3f77-44f6-864d-06c7a722a0e1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.198605 Jun 24 10:40:15.200085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 281/569] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:14 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:16.222532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:16.223522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:16.231322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.231766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:16.232563 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.233023 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:16.381975 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:16.390506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:16.392007 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:16.393195 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d73ecc6c-651c-4f88-8dd5-35a301e166bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.177761 Jun 24 10:40:16.393757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 289/570] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:16 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:16.882652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:16.883546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:16.890566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.891011 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:16.891775 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.892211 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:16.921669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-91b16e54-3689-4161-8127-5dd0c03c3bee tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043219 Jun 24 10:40:16.926847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 282/571] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:40:16 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:40:16.982027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:16.982510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:16.988775 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.989446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:16.990205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:16.990641 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:17.010359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:17.018164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:17.103050 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3d687bd1-3248-4f71-8422-861251f4ca22 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 204 len: 0 microversion: 2.1 time: 0.125407 Jun 24 10:40:17.103984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 290/572] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:40:16 2022] DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:17.112093 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:17.112947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:17.119283 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:17.119737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:17.120485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:17.120944 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:17.271149 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:17.278786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c65fcf05-afdc-4dfe-96c1-1d6625fe299c tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1673 microversion: 2.1 time: 0.170703 Jun 24 10:40:17.279371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 283/573] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:17 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:17.418062 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:17.418991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:17.428073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:17.428675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:17.429947 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:17.430392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:17.563299 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:17.576503 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:17.578809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:17.580427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a0525b4c-ee0f-4d57-b77c-9fb1c7e163dd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.168006 Jun 24 10:40:17.581280 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 291/574] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:17 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:18.297941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:18.299632 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:18.309382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:18.310480 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:18.311683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:18.312315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:18.340082 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:18.600289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:18.601157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:18.608628 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:18.609493 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:18.610357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:18.610864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:18.765787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:18.774109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-021f5cd4-ab03-4b40-8635-7e593dc1e914 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1673 microversion: 2.1 time: 0.482160 Jun 24 10:40:18.774770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 284/575] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:18 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1673 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:18.796632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:18.805504 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:18.807002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:18.808122 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-03f8f50d-fe71-445e-acab-f1c3b2449d87 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.211975 Jun 24 10:40:18.808685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 292/576] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:18 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:19.796218 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:19.797086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:19.800026 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:19.801144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=10 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:19.808927 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:19.809376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:19.810135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:19.810566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:19.826357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:19.827047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:19.829090 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:19.835279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:19.835717 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:19.836787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:19.837239 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:19.991020 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:19.999025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-96ade8d3-7a4b-4c3e-b529-5c005dc87ce0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1673 microversion: 2.1 time: 0.210150 Jun 24 10:40:19.999603 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 285/577] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:19 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:20.013269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:20.021616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:20.023093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:20.024428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cc1cd3fd-96e6-4d62-b8ca-14c09d7dcf22 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.202054 Jun 24 10:40:20.025019 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 293/578] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:19 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:21.021090 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:21.022013 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:21.029645 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.030080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.030833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.031255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.044233 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:21.044872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:21.051973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.052423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.053229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.053650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.221875 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:21.229854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-08cf6c10-2c92-4e79-acf4-e674ac8ebf87 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1673 microversion: 2.1 time: 0.215158 Jun 24 10:40:21.230492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 286/579] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:21 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:21.235257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:21.235719 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:21.241700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.242144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.243061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.243292 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:21.243604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.251334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:21.252880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:21.253992 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-702910c2-e64d-48f8-ba01-35db90c72f09 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.215492 Jun 24 10:40:21.254547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 294/580] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:21 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:21.328555 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lazy-loading 'services' on Instance uuid 6456f179-5c11-462c-920a-a8939662cdde {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:40:21.409938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-31ebdbc5-1510-4aee-bd61-ad9f14c598ea tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments/c5312f43-3355-4ad8-a35a-67ff5dd12987" status: 202 len: 0 microversion: 2.1 time: 0.178049 Jun 24 10:40:21.410509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 287/581] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:40:21 2022] DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments/c5312f43-3355-4ad8-a35a-67ff5dd12987 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:40:21.419304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:21.420269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:21.426748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.427196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.427959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:21.428395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:21.460423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ab73631e-1b40-4b62-8c10-6cb36279d056 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Jun 24 10:40:21.460840 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 295/582] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:40:21 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:22.248323 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:22.249240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:22.256035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.256684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.257660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.259143 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.272338 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-c9d921ad-907c-4af4-a01d-fe72682f4537 req-4ed88f13-24c1-4171-863b-048d730856b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "name": "network-vif-plugged", "status": "completed", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:22.287822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c9d921ad-907c-4af4-a01d-fe72682f4537 req-4ed88f13-24c1-4171-863b-048d730856b3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.288882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c9d921ad-907c-4af4-a01d-fe72682f4537 req-4ed88f13-24c1-4171-863b-048d730856b3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.303671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-c9d921ad-907c-4af4-a01d-fe72682f4537 req-4ed88f13-24c1-4171-863b-048d730856b3 service nova] Creating event network-vif-plugged:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:40:22.310076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-c9d921ad-907c-4af4-a01d-fe72682f4537 req-4ed88f13-24c1-4171-863b-048d730856b3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043294 Jun 24 10:40:22.311099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 296/583] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:40:22.316864 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:22.317869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:22.339915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.340479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.341362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.341804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.567754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:22.581600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-304b0fcf-b8d0-4949-bc91-32b174f786fa tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1673 microversion: 2.1 time: 0.337893 Jun 24 10:40:22.582744 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 288/584] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:22 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1673 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:22.588988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:22.590557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:22.598974 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.599858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.600932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.602281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.639802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-42e39f05-66f0-4036-b68b-340a5b42cd5b tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055418 Jun 24 10:40:22.640792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 289/585] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:40:22 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:40:22.656598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:22.667178 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:22.669633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:22.671514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f1565d3b-7823-4f1f-a585-0b2db72a15b4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.359118 Jun 24 10:40:22.673060 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 297/586] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:22 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:22.726727 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:22.727274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:22.733691 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.734141 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.734910 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.735400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.764687 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:22.859154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b2d9bb1f-7693-4596-892c-5a29733cc15f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 204 len: 0 microversion: 2.1 time: 0.135092 Jun 24 10:40:22.860185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 290/587] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:40:22 2022] DELETE /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:22.873765 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:22.874700 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:22.883236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.884059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:22.885411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:22.885977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.128529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:23.144147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1d6c4394-05ed-4119-a048-6740f79e347c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1691 microversion: 2.1 time: 0.278838 Jun 24 10:40:23.154725 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 298/588] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:22 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:23.404931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-07af662f-668c-46c2-8b79-559024195234 req-98cc6253-c5a2-4444-81b3-1656e06c8f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332b01da-30de-4466-9408-485f644e52f7", "name": "network-vif-deleted", "tag": "60ac0302-9580-42af-834e-0673bcdbf476"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:23.414112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-07af662f-668c-46c2-8b79-559024195234 req-98cc6253-c5a2-4444-81b3-1656e06c8f19 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:23.414600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-07af662f-668c-46c2-8b79-559024195234 req-98cc6253-c5a2-4444-81b3-1656e06c8f19 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.427715 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-07af662f-668c-46c2-8b79-559024195234 req-98cc6253-c5a2-4444-81b3-1656e06c8f19 service nova] Creating event network-vif-deleted:60ac0302-9580-42af-834e-0673bcdbf476 for instance 332b01da-30de-4466-9408-485f644e52f7 on hv-cinder-84753 Jun 24 10:40:23.437544 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-07af662f-668c-46c2-8b79-559024195234 req-98cc6253-c5a2-4444-81b3-1656e06c8f19 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Jun 24 10:40:23.440551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 291/589] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:23.604040 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:23.604780 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:23.611954 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:23.612403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.613304 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:23.613823 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.681649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:23.689758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8dffb62c-2c22-44f9-8305-35f1faa24885 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1605 microversion: 2.1 time: 0.089864 Jun 24 10:40:23.690625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 299/590] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:23 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:23.703612 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:23.704301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:23.710635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:23.711154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.711933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:23.712357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:23.849357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:23.858005 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:23.859521 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:23.860624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e5096cc2-8224-46a6-8238-536ad0e289f7 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.168912 Jun 24 10:40:23.861225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 292/591] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:23 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:40:24.164521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:24.164521 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:24.170500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.170931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:24.171696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.172125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:24.309094 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:24.316715 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-021dd61d-c52c-4423-8a5f-d6f42c83c72a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1691 microversion: 2.1 time: 0.158162 Jun 24 10:40:24.317361 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 300/592] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:24 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:24.708783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:24.709526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:24.718936 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.719528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:24.720542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.721175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:24.787601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:24.795073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4fac982d-4528-46bf-976c-d616147af5c8 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1605 microversion: 2.1 time: 0.091506 Jun 24 10:40:24.795665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 293/593] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:24 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1605 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:24.882170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:24.883313 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:24.894464 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.895201 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:24.896839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:24.897595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:25.221004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:25.229226 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:25.230781 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:25.231882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-63209fe8-4024-432d-a7df-157ba9a1ffb5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.356317 Jun 24 10:40:25.232438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 301/594] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:24 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:25.333694 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:25.334501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:25.341400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:25.341851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:25.342610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:25.343041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:25.526102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:25.534254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2808f6f0-7e5b-4eee-a204-a7a23c8ee275 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1691 microversion: 2.1 time: 0.204272 Jun 24 10:40:25.534830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 294/595] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:25 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:25.816629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:25.817480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:25.827915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:25.828653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:25.829961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:25.830684 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:25.897473 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:25.905422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-56d7905f-853f-4ba9-b520-bda1880831b7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1605 microversion: 2.1 time: 0.095450 Jun 24 10:40:25.905995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 302/596] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:25 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:26.254830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:26.255856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:26.259535 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.265070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.265496 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.266289 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.266684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.404222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:26.412402 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:26.414023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:26.415349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-72362590-cbb0-4184-9541-925723852bd3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1408 microversion: 2.20 time: 0.167140 Jun 24 10:40:26.415993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 295/597] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:26 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:26.558070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:26.559245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:26.565707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:26.567435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.567893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.568764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.569222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.708537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:26.717003 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0adc6fb0-4652-4e05-83dc-ca99ee87102e tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1691 microversion: 2.1 time: 0.163491 Jun 24 10:40:26.717578 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 303/598] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:26 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:26.923027 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:26.923648 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:26.930322 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.930702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.931467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.931896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.966987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:26.967705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:26.968487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lazy-loading 'fault' on Instance uuid 332b01da-30de-4466-9408-485f644e52f7 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:40:27.037696 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:27.046983 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4adf5e48-1d31-48ed-83af-0a898b4690bb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 200 len: 1327 microversion: 2.1 time: 0.127859 Jun 24 10:40:27.047560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 296/599] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:26 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:27.448494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:27.449338 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:27.461459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.462002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.469267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.469720 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.669973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:27.679402 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:27.681024 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:27.682336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-33d728fe-2a57-4160-847e-ca17729544f6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1599 microversion: 2.20 time: 0.241067 Jun 24 10:40:27.683060 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 304/600] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:40:27 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:40:27.700231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:27.700929 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:27.707376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.707826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.708590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.709050 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.734874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:27.739152 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:27.748266 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.749079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.749927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.750594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.853683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:27.869077 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a26c99a6-92f8-414f-b6ec-849489388653 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.172840 Jun 24 10:40:27.869665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 297/601] 10.222.0.69 () {60 vars in 1315 bytes} [Fri Jun 24 10:40:27 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:40:27.875527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-e94add0a-fd44-4dd8-8491-cb56a9b99969 req-86db5e6a-70e8-40c8-9480-46e92cd2821b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6456f179-5c11-462c-920a-a8939662cdde", "name": "network-vif-deleted", "tag": "0eef209c-31b8-4128-91c4-b268848f7512"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:27.876612 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-57c65d25-5639-4c82-8b51-e5b7529fbc4c tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 200 len: 1623 microversion: 2.1 time: 0.138494 Jun 24 10:40:27.884231 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 305/602] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:27 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 1623 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:27.890295 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-e94add0a-fd44-4dd8-8491-cb56a9b99969 req-86db5e6a-70e8-40c8-9480-46e92cd2821b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:27.890734 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-e94add0a-fd44-4dd8-8491-cb56a9b99969 req-86db5e6a-70e8-40c8-9480-46e92cd2821b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:27.910532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-e94add0a-fd44-4dd8-8491-cb56a9b99969 req-86db5e6a-70e8-40c8-9480-46e92cd2821b service nova] Creating event network-vif-deleted:0eef209c-31b8-4128-91c4-b268848f7512 for instance 6456f179-5c11-462c-920a-a8939662cdde on hv-cinder-84753 Jun 24 10:40:27.933880 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-e94add0a-fd44-4dd8-8491-cb56a9b99969 req-86db5e6a-70e8-40c8-9480-46e92cd2821b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061649 Jun 24 10:40:27.935707 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 298/603] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:28.067635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:28.068290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:28.075130 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:28.075573 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:28.076337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:28.077185 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:28.082228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:28.093062 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 HTTP/1.1 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:40:28.095357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:40:28.097079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '332b01da-30de-4466-9408-485f644e52f7'} Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:28.098098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:40:28.099355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.100418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:28.100418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6a349446-7d38-41cf-8a05-81c73cc345e9 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 404 len: 111 microversion: 2.1 time: 0.033927 Jun 24 10:40:28.100418 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 306/604] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:28 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:40:28.107520 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0340fd42-f22c-4d2c-83f5-a6074c58cc80 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '.version_select at 0x7f1762032670>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:28.129031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0340fd42-f22c-4d2c-83f5-a6074c58cc80 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607141775" status: 202 len: 0 microversion: 2.1 time: 0.025781 Jun 24 10:40:28.130019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 299/605] 10.222.0.69 () {58 vars in 1217 bytes} [Fri Jun 24 10:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607141775 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:40:28.898108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:28.899816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 6456f179-5c11-462c-920a-a8939662cdde] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:28.910140 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:28.911801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:28.912946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:28.913855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:28.932000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] HTTP exception thrown: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Request method failure captured: Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde HTTP/1.1 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN-gToLcv_Sslb-xAViBn5WFYlOn0CANhAFQgPBFr4cZReX6DxYRmi1nOG8IVpkxzFjShoHKF6T5U_OTbYFRSOsV7fljzYxlSLN0CRHQglHZKz9nmBmYZqF-1kfZZL7PbZ18jFOjVaYKD7AnIvya4F7qCFsoLnPvAugqr_6vJ39pT0 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:40:28.934173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8cc166ec03349b3b2b0d69840886bd9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 960b18fe180f4185b291da1d9c18a2fa Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. Jun 24 10:40:28.935629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '6456f179-5c11-462c-920a-a8939662cdde'} Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:28.936398 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. Jun 24 10:40:28.937661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:40:28.941155 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Returning 404 to user: Instance 6456f179-5c11-462c-920a-a8939662cdde could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:28.942425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2ca78f58-e903-44eb-b391-693b4e443aac tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde" status: 404 len: 111 microversion: 2.1 time: 0.051400 Jun 24 10:40:28.943704 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 307/606] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:28 2022] GET /compute/v2.1/servers/6456f179-5c11-462c-920a-a8939662cdde => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:40:28.953710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f40abc4d-633f-4753-aa00-308b026e5455 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '.version_select at 0x7f17620f5af0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:28.982902 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f40abc4d-633f-4753-aa00-308b026e5455 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008615593" status: 202 len: 0 microversion: 2.1 time: 0.034531 Jun 24 10:40:28.983503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 300/607] 10.222.0.69 () {58 vars in 1220 bytes} [Fri Jun 24 10:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008615593 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:40:29.163518 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ed0566dc-c8d1-48e2-b328-29e8d0f7b3ea tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: .version_select at 0x7f1762887af0>, body: {"keypair": {"name": "tempest-keypair-731491973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAJrAehs2returMkYEJmpfGnAg4IsNCn0n+ozT04qK9tBpfM0A27wml3j4E6YFm/7ysvmEiAOUX+0pk0+tHKYOfoS7GnrgWQx35sAfgC2xp3MPnoeJtvfCdfFmzrVrWyA=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:29.180516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-ed0566dc-c8d1-48e2-b328-29e8d0f7b3ea tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for project e41afc594f464d74bd4881e07dd33e45. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:40:29.185772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-ed0566dc-c8d1-48e2-b328-29e8d0f7b3ea tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for user 733b7d5058da45089a2133e2fe4695e7 and project e41afc594f464d74bd4881e07dd33e45. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:40:29.229127 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ed0566dc-c8d1-48e2-b328-29e8d0f7b3ea tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069532 Jun 24 10:40:29.230172 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 308/608] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:40:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:29.957046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-426b0bf1-5e4e-48c6-8dd8-da4a9b0c3c53 req-ec3a3790-728e-4bf9-a626-1396d374f94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:29.970694 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-426b0bf1-5e4e-48c6-8dd8-da4a9b0c3c53 req-ec3a3790-728e-4bf9-a626-1396d374f94e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:29.974126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-426b0bf1-5e4e-48c6-8dd8-da4a9b0c3c53 req-ec3a3790-728e-4bf9-a626-1396d374f94e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:29.990615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-426b0bf1-5e4e-48c6-8dd8-da4a9b0c3c53 req-ec3a3790-728e-4bf9-a626-1396d374f94e service nova] Creating event network-changed:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:40:29.996886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-426b0bf1-5e4e-48c6-8dd8-da4a9b0c3c53 req-ec3a3790-728e-4bf9-a626-1396d374f94e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043451 Jun 24 10:40:29.997972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 301/609] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:31.365183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-778125492", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45f93fe-c90f-4708-aa2a-5a1fde71bcad"}], "security_groups": [{"name": "tempest-securitygroup--93218298"}], "key_name": "tempest-keypair-731491973", "user_data": "}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:31.488445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] validate_networks() for [('d45f93fe-c90f-4708-aa2a-5a1fde71bcad', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:40:31.862599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:40:31.863017 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:40:31.863490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:40:31.863893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:40:31.864305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:40:31.874146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:31.874598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:31.875388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:31.875820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:31.893217 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for project e41afc594f464d74bd4881e07dd33e45. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:40:31.897987 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Getting quotas for user 733b7d5058da45089a2133e2fe4695e7 and project e41afc594f464d74bd4881e07dd33e45. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:40:31.910363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:40:31.912652 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:40:31.961537 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8516557a-fdba-40f3-a78e-7ab6754a18e3 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.602154 Jun 24 10:40:31.962371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 309/610] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:40:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:40:31.973795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cae4e5e2-1b20-4e08-98c1-8e1967bb7382 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:31.974654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cae4e5e2-1b20-4e08-98c1-8e1967bb7382 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:32.030189 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cae4e5e2-1b20-4e08-98c1-8e1967bb7382 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:32.037757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cae4e5e2-1b20-4e08-98c1-8e1967bb7382 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1236 microversion: 2.1 time: 0.068723 Jun 24 10:40:32.038336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 302/611] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:31 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:40:32.462704 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:32.463150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:32.471164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:32.471607 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:32.472371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:32.472825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:32.500016 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:32.589622 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-db14c1a3-d1cf-4cfb-a508-86fbadbfedd7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 204 len: 0 microversion: 2.1 time: 0.130803 Jun 24 10:40:32.590214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 310/612] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:40:32 2022] DELETE /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:32.599281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:32.599894 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:32.606600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:32.607171 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:32.608081 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:32.608686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:32.824794 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:32.828348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.833087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-45563ba4-f721-42a0-8c7c-c29cf8e28f01 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1508 microversion: 2.1 time: 0.238128 Jun 24 10:40:32.833677 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 303/613] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:32 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:33.056590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:33.057465 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:33.064392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:33.064935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:33.066075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:33.066516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:33.131322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:33.139962 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6d9dd08e-9541-4db8-8c45-29576bd3fc26 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1288 microversion: 2.1 time: 0.088154 Jun 24 10:40:33.140842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 311/614] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:33 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:33.855072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:33.856008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:33.867650 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:33.868730 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:33.869469 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:33.869899 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:34.000761 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:34.009106 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f70834ea-63af-47b3-a2d8-1a9df17e237f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1508 microversion: 2.1 time: 0.160980 Jun 24 10:40:34.009661 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 304/615] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:33 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:34.399593 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:34.400229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:34.406534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:34.406967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:34.407728 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:34.408159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:34.472621 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:34.482039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-38605b0f-009f-4379-8882-e7798ced8a04 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1288 microversion: 2.1 time: 0.326925 Jun 24 10:40:34.482607 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 312/616] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:34 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1288 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:35.030444 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:35.031401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:35.041938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:35.042380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:35.043145 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:35.043577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:35.289533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:35.298117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-67af739f-b362-4afc-9ed8-12a096cf5fa3 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 200 len: 1508 microversion: 2.1 time: 0.274263 Jun 24 10:40:35.298703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 305/617] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:35 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:35.499553 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:35.500232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:35.507431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:35.507952 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:35.508899 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:35.509590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:35.609465 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-aa994e99-1241-45f8-aba3-f8eb9610cf37 req-cbe95cf3-f010-4aa7-b724-7f29423a7c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e28d99-9c93-4c12-922b-a8a0bafae207", "name": "network-vif-deleted", "tag": "e14124f9-29f1-48ef-b539-1d53a03433bb"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:35.618076 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-aa994e99-1241-45f8-aba3-f8eb9610cf37 req-cbe95cf3-f010-4aa7-b724-7f29423a7c3e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:35.618543 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-aa994e99-1241-45f8-aba3-f8eb9610cf37 req-cbe95cf3-f010-4aa7-b724-7f29423a7c3e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:35.625836 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:35.631377 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-aa994e99-1241-45f8-aba3-f8eb9610cf37 req-cbe95cf3-f010-4aa7-b724-7f29423a7c3e service nova] Creating event network-vif-deleted:e14124f9-29f1-48ef-b539-1d53a03433bb for instance 22e28d99-9c93-4c12-922b-a8a0bafae207 on hv-cinder-84753 Jun 24 10:40:35.634336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-595e87ff-9f40-4457-b3d6-174bca158c68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1294 microversion: 2.1 time: 0.138911 Jun 24 10:40:35.636996 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-aa994e99-1241-45f8-aba3-f8eb9610cf37 req-cbe95cf3-f010-4aa7-b724-7f29423a7c3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Jun 24 10:40:35.637805 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 306/618] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:40:35.644771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 313/619] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:35 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1294 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:36.316518 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:36.317326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 22e28d99-9c93-4c12-922b-a8a0bafae207] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:36.323906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.324566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.325515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.326098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.347500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] HTTP exception thrown: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Request method failure captured: Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 HTTP/1.1 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-gToLcv_Sslb-xAViBn5WFYlOn0CANhAFQgPBFr4cZReX6DxYRmi1nOG8IVpkxzFjShoHKF6T5U_OTbYFRSOsV7fljzYxlSLN0CRHQglHZKz9nmBmYZqF-1kfZZL7PbZ18jFOjVaYKD7AnIvya4F7qCFsoLnPvAugqr_6vJ39pT0 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:40:36.349191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8cc166ec03349b3b2b0d69840886bd9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 960b18fe180f4185b291da1d9c18a2fa Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. Jun 24 10:40:36.350699 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '22e28d99-9c93-4c12-922b-a8a0bafae207'} Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:36.354786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. Jun 24 10:40:36.356073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:36.357361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Returning 404 to user: Instance 22e28d99-9c93-4c12-922b-a8a0bafae207 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:36.357361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-71de3354-bae9-49bf-9bc7-7ee1cb2bda74 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207" status: 404 len: 111 microversion: 2.1 time: 0.038841 Jun 24 10:40:36.357361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 307/620] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:36 2022] GET /compute/v2.1/servers/22e28d99-9c93-4c12-922b-a8a0bafae207 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:40:36.359584 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:36.360073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:36.366423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.367001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.367769 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.368338 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.396234 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:40:36.506376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8859910e-1c90-4a1c-837d-c2a0f1f10706 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "DELETE /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 204 len: 0 microversion: 2.1 time: 0.150411 Jun 24 10:40:36.508809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 314/621] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:40:36 2022] DELETE /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:40:36.515522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:36.516407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:36.522725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.523162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.524160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.524596 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.654631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:36.655476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:36.663125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.665871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.665871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.666688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:36.799422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:36.807395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d8699822-b2f5-4444-995b-357c34e2929a tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.295805 Jun 24 10:40:36.813388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 308/622] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:36 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:36.895680 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:36.904045 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-06497fa3-7a0b-427c-b1ad-cb287a9dfda5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.255647 Jun 24 10:40:36.904634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 315/623] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:36 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:36.979536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-6d43dc9c-95f4-4aee-89bf-524361435bf5 req-c72ead8c-a02d-48d9-b28a-b497c3dab405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074c1c69-718f-40a6-bacf-98f29f7a33c5", "tag": "9f634125-4668-43db-831a-285df3eb2a83"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:36.988032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6d43dc9c-95f4-4aee-89bf-524361435bf5 req-c72ead8c-a02d-48d9-b28a-b497c3dab405 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:36.988760 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-6d43dc9c-95f4-4aee-89bf-524361435bf5 req-c72ead8c-a02d-48d9-b28a-b497c3dab405 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:37.001398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-6d43dc9c-95f4-4aee-89bf-524361435bf5 req-c72ead8c-a02d-48d9-b28a-b497c3dab405 service nova] Creating event network-changed:9f634125-4668-43db-831a-285df3eb2a83 for instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 on hv-cinder-84753 Jun 24 10:40:37.006627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-6d43dc9c-95f4-4aee-89bf-524361435bf5 req-c72ead8c-a02d-48d9-b28a-b497c3dab405 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Jun 24 10:40:37.007355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 309/624] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:37.828906 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:37.829739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:37.839749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:37.840188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:37.840995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:37.841424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:37.921679 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:37.922376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:37.928912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:37.929409 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:37.930089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:37.930517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:38.006244 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:38.014030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5d4c2c04-7d24-45e2-a44c-3044d16941f8 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.191844 Jun 24 10:40:38.014605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 316/625] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:37 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:38.069855 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:38.078089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cad53498-4631-4be4-934e-85ca983cb3cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.161220 Jun 24 10:40:38.078665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 310/626] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:37 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:39.033368 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:39.034075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:39.042788 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:39.043330 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:39.044263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:39.044854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:39.095365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:39.095958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:39.102646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:39.103083 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:39.103869 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:39.104504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:39.229929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:39.238238 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2a01b073-6af9-4d63-b23c-fe2dc347639f tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1521 microversion: 2.1 time: 0.209758 Jun 24 10:40:39.239577 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 317/627] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:39 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:39.301073 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:39.308594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-874865d9-2c9b-4933-a8f6-14fa3362a577 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.217578 Jun 24 10:40:39.309201 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 311/628] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:39 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:40:40.068317 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-d07b272e-a33a-4d9a-8a0a-d7926f091d5b req-2adcb451-4f83-4685-b11e-26af30488f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e01d68-1575-4d74-8a50-e28d234be279", "name": "network-vif-deleted", "tag": "d611db02-d3d2-4654-b123-836d4c7a6d99"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:40.080083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-d07b272e-a33a-4d9a-8a0a-d7926f091d5b req-2adcb451-4f83-4685-b11e-26af30488f04 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.080638 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-d07b272e-a33a-4d9a-8a0a-d7926f091d5b req-2adcb451-4f83-4685-b11e-26af30488f04 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.096597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-d07b272e-a33a-4d9a-8a0a-d7926f091d5b req-2adcb451-4f83-4685-b11e-26af30488f04 service nova] Creating event network-vif-deleted:d611db02-d3d2-4654-b123-836d4c7a6d99 for instance 21e01d68-1575-4d74-8a50-e28d234be279 on hv-cinder-84753 Jun 24 10:40:40.101595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-d07b272e-a33a-4d9a-8a0a-d7926f091d5b req-2adcb451-4f83-4685-b11e-26af30488f04 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039167 Jun 24 10:40:40.102228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 318/629] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:40.257277 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:40.257908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:40.264770 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.265252 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.266029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.266453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.311042 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.311396 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.311828 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lazy-loading 'fault' on Instance uuid 21e01d68-1575-4d74-8a50-e28d234be279 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:40:40.326453 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:40.327121 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:40.334111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.334560 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.335337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:40.335770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:40.354144 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960b18fe180f4185b291da1d9c18a2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cc166ec03349b3b2b0d69840886bd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:40.362937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ecedf049-7564-4490-943b-6ab0010a7d58 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 200 len: 1311 microversion: 2.1 time: 0.109473 Jun 24 10:40:40.363826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 312/630] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:40 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:40.481196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:40.489888 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-00238e8f-9ac9-4566-880b-2eb6d10b7648 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.167697 Jun 24 10:40:40.490495 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 319/631] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:40 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:41.383656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:41.384504 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] [instance: 21e01d68-1575-4d74-8a50-e28d234be279] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:41.395530 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:41.396261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:41.397556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:41.398319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:41.413331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] HTTP exception thrown: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Request method failure captured: Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 HTTP/1.1 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-gToLcv_Sslb-xAViBn5WFYlOn0CANhAFQgPBFr4cZReX6DxYRmi1nOG8IVpkxzFjShoHKF6T5U_OTbYFRSOsV7fljzYxlSLN0CRHQglHZKz9nmBmYZqF-1kfZZL7PbZ18jFOjVaYKD7AnIvya4F7qCFsoLnPvAugqr_6vJ39pT0 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:40:41.414989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d8cc166ec03349b3b2b0d69840886bd9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d8cc166ec03349b3b2b0d69840886bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: d8cc166ec03349b3b2b0d69840886bd9 Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1238548787 Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 960b18fe180f4185b291da1d9c18a2fa Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1238548787-project Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. Jun 24 10:40:41.416545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '21e01d68-1575-4d74-8a50-e28d234be279'} Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:40:41.417320 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. Jun 24 10:40:41.418884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:40:41.420130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] Returning 404 to user: Instance 21e01d68-1575-4d74-8a50-e28d234be279 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:40:41.420130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c7501592-4924-42b3-8d4d-a086a1f823e7 tempest-ServerRescueNegativeTestJSON-1238548787 tempest-ServerRescueNegativeTestJSON-1238548787-project] 10.222.0.69 "GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279" status: 404 len: 111 microversion: 2.1 time: 0.039431 Jun 24 10:40:41.420130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 313/632] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:41 2022] GET /compute/v2.1/servers/21e01d68-1575-4d74-8a50-e28d234be279 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:40:41.506347 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:41.506953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:41.513901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:41.514332 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:41.515134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:41.515580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:41.645314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:41.653308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0aad3e6b-141c-45d3-9153-2f6ffcf07ecb tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.150811 Jun 24 10:40:41.653848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 320/633] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:41 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:42.671029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:42.671829 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:42.677120 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:42.679779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:42.680217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:42.681156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:42.681768 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:42.837833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:42.847856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3d5d58e8-54e2-4c8d-80ea-1fc26e642881 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.181582 Jun 24 10:40:42.857212 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 314/634] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:42 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:43.864855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:43.865436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:43.867487 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.868144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=10 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:43.874876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:43.875333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:43.876102 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:43.876624 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:44.009268 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:44.017123 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e8be617d-5009-4754-9651-d6062ae86509 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.156131 Jun 24 10:40:44.017672 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 321/635] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:43 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:44.344264 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-8e7a4d2b-cdd7-4da8-865d-22a267fb2770 req-b48fbe7a-469f-414f-b0ff-b72407d71c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074c1c69-718f-40a6-bacf-98f29f7a33c5", "name": "network-vif-plugged", "status": "completed", "tag": "9f634125-4668-43db-831a-285df3eb2a83"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:44.354965 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8e7a4d2b-cdd7-4da8-865d-22a267fb2770 req-b48fbe7a-469f-414f-b0ff-b72407d71c7f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:44.355534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-8e7a4d2b-cdd7-4da8-865d-22a267fb2770 req-b48fbe7a-469f-414f-b0ff-b72407d71c7f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:44.369528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-8e7a4d2b-cdd7-4da8-865d-22a267fb2770 req-b48fbe7a-469f-414f-b0ff-b72407d71c7f service nova] Creating event network-vif-plugged:9f634125-4668-43db-831a-285df3eb2a83 for instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 on hv-cinder-84753 Jun 24 10:40:44.375361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-8e7a4d2b-cdd7-4da8-865d-22a267fb2770 req-b48fbe7a-469f-414f-b0ff-b72407d71c7f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039818 Jun 24 10:40:44.376689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 315/636] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:45.034749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:45.035256 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:45.042336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:45.042979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:45.043927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:45.044419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:45.195517 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:45.205007 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1e904d63-5528-406b-8439-d67f75330da0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1360 microversion: 2.1 time: 0.173085 Jun 24 10:40:45.205871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 322/637] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:45 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:46.223422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:46.224121 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:46.230431 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:46.230950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:46.232473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:46.232932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:46.370635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:40:46.379751 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0b43ebfc-4295-461a-a223-278bd74cf3c5 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1545 microversion: 2.1 time: 0.161371 Jun 24 10:40:46.380494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 316/638] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:40:46 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1545 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:40:46.397221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:40:46.397763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:40:46.405069 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:46.405568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:46.406473 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:46.406901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:46.413633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:46.491358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-af6c0f7f-1fd9-4cc9-a395-897761fca2c6 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098396 Jun 24 10:40:46.491982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 323/639] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:40:46 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:40:47.471846 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-88c48af2-b489-4667-8d16-a0e68871b6e4 req-f410dfae-68b3-47b0-887b-14922e42bb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074c1c69-718f-40a6-bacf-98f29f7a33c5", "tag": "9f634125-4668-43db-831a-285df3eb2a83"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:40:47.480712 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-88c48af2-b489-4667-8d16-a0e68871b6e4 req-f410dfae-68b3-47b0-887b-14922e42bb26 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:40:47.481620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-88c48af2-b489-4667-8d16-a0e68871b6e4 req-f410dfae-68b3-47b0-887b-14922e42bb26 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:40:47.492684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-88c48af2-b489-4667-8d16-a0e68871b6e4 req-f410dfae-68b3-47b0-887b-14922e42bb26 service nova] Creating event network-changed:9f634125-4668-43db-831a-285df3eb2a83 for instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 on hv-cinder-84753 Jun 24 10:40:47.498683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-88c48af2-b489-4667-8d16-a0e68871b6e4 req-f410dfae-68b3-47b0-887b-14922e42bb26 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030794 Jun 24 10:40:47.499488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 317/640] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:05.395804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.396477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:05.578010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:05.578723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:05.585089 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:05.585529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:05.586293 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:05.586722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:05.610167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0bc983a0-104e-4c0e-a43a-6cd626e88be9 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/ips" status: 200 len: 151 microversion: 2.20 time: 0.215997 Jun 24 10:41:05.610730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 324/641] 10.222.0.69 () {60 vars in 1288 bytes} [Fri Jun 24 10:41:05 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/ips => generated 151 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:41:07.401499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.402244 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=62 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:07.408451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:07.409323 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:07.417204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:07.417658 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:07.418453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:07.418885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:07.442164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lazy-loading 'flavor' on Instance uuid ef17986c-1f72-461f-ad90-a81148f083a9 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:41:07.711344 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6820c0d6-0483-436d-a23f-10be3d4ec094 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/action" status: 202 len: 0 microversion: 2.20 time: 0.312665 Jun 24 10:41:07.711951 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 318/642] 10.222.0.69 () {62 vars in 1318 bytes} [Fri Jun 24 10:41:07 2022] POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:41:07.720991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:07.721585 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:07.728234 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:07.728678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:07.729515 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:07.729919 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:07.865971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:07.874192 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:07.875686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:07.876883 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0a45b66f-f0a5-4d44-be1c-84b25d349cac tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.160248 Jun 24 10:41:07.877437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 325/643] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:07 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:08.907474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:08.908625 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:08.916374 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:08.916850 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:08.917613 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:08.918043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:09.048362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:09.057683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:09.059165 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:09.060326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ca5d3fd6-bab0-4a37-887c-a6f2851860ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.161092 Jun 24 10:41:09.060915 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 319/644] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:08 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:10.084863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:10.085540 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:10.093594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:10.094480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:10.095381 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:10.095898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:10.260143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:10.273514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:10.275873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:10.277673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-477a1777-8bfc-42a5-ae86-c7e8ba4f4e5e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.198704 Jun 24 10:41:10.278423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 326/645] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:10 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:11.303958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:11.305029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:11.315824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:11.316556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:11.317574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:11.317989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:11.459426 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:11.470901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:11.473333 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:11.475064 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-56945824-4843-4772-a481-6ffc137ebb82 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.178017 Jun 24 10:41:11.475747 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 320/646] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:11 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:12.494135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:12.494745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:12.501497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:12.501951 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:12.502719 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:12.503154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:12.635600 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:12.643716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:12.645233 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:12.646389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0cb5bdcc-ed91-4480-8578-5f032f0ddcf3 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.156744 Jun 24 10:41:12.646951 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 327/647] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:12 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:13.674596 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:13.675576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:13.683641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:13.684086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:13.684860 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:13.685285 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:13.820546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:13.828942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:13.830423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:13.831573 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-414f247d-5b15-468e-8a65-99508b035de0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.163904 Jun 24 10:41:13.832140 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 321/648] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:13 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:14.852796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:14.853374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:14.860618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:14.861111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:14.861896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:14.862325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:14.999459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:15.008103 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:15.009635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:15.010799 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-53a7283d-77f5-4cff-8db3-1982c31bfc43 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.163119 Jun 24 10:41:15.011371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 328/649] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:14 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:16.033009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:16.034034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:16.045125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:16.045858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:16.047102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:16.047819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:16.193422 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:16.201598 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:16.203136 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:16.204290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3806b274-346e-4da3-b175-2c80b62e88d1 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.177815 Jun 24 10:41:16.204882 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 322/650] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:16 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:17.226880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:17.227648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:17.236907 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:17.237530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:17.238544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:17.239123 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:17.383661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:17.391757 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:17.393306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:17.394472 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b9e374fb-cadf-49d9-83ce-51dbabb7454b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.173974 Jun 24 10:41:17.395055 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 329/651] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:17 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:18.419610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:18.420444 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:18.430846 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:18.431291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:18.432056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:18.432484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:18.571987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:18.582213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:18.584459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:18.586288 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bcfd3149-72a6-46ba-816b-0e63beaad53a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.175630 Jun 24 10:41:18.586968 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 323/652] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:18 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:19.613501 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:19.614475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:19.623231 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:19.623754 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:19.624651 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:19.625196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:19.758431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:19.766727 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:19.768212 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:19.769403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e63e9fbf-3c4a-4bac-b05b-36220eb18445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.162769 Jun 24 10:41:19.769966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 330/653] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:19 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:20.791182 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:20.791848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:20.799983 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:20.800532 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:20.801512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:20.802038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:20.940667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:20.950552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:20.952020 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:20.953215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8d17f5e1-ebdf-46f4-8a68-a526ecdbcea5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.167807 Jun 24 10:41:20.953783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 324/654] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:20 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:21.972178 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:21.972892 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:21.979559 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:21.979999 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:21.980764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:21.981219 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:22.377800 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:22.385821 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:22.387327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:22.388496 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f99e7468-5e86-4bc2-9758-8256c2e7b3ae tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.420751 Jun 24 10:41:22.389126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 331/655] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:21 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:23.407039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:23.407663 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:23.414270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:23.414707 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:23.415524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:23.415952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:23.571833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:23.586896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:23.588394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:23.591637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e1f52038-9f04-4f57-9d9e-37df285c5445 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.188381 Jun 24 10:41:23.592435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 325/656] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:23 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:24.613991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:24.614605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:24.622126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:24.622569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:24.623324 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:24.623754 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:24.766522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:24.774618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:24.776108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:24.777285 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-fb7c55d3-7d65-45f3-b10f-8e1414c2028e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.167231 Jun 24 10:41:24.777854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 332/657] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:24 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:25.804675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:25.805242 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:25.814791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:25.815401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:25.816568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:25.817175 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:25.960713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:25.970055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:25.971556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:25.972705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e30eacf3-02e8-4f8b-9f60-3219bf550d16 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.173582 Jun 24 10:41:25.973300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 326/658] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:25 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:26.991452 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:26.992039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:26.998904 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:26.999381 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:27.000139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:27.000574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:27.145843 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:27.153856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:27.155349 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:27.156480 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-40df0599-44b1-4c20-aae5-f48e820a0dc0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1745 microversion: 2.20 time: 0.169272 Jun 24 10:41:27.157075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 333/659] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:26 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:28.177241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:28.177864 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:28.184771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:28.185266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:28.186027 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:28.186452 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:28.320249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:28.328225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:28.329649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:28.330813 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5735cd5f-790d-4339-b9e8-2d6108e06b0b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1745 microversion: 2.20 time: 0.157684 Jun 24 10:41:28.331364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 327/660] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:28 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:29.349862 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:29.351139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:29.360041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:29.360830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:29.362025 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:29.362740 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:29.520099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:29.532809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:29.534447 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:29.535626 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e8f9a907-d664-4453-892a-d21e83ff48f5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.189875 Jun 24 10:41:29.536362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 334/661] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:29 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:30.553875 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:30.554481 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:30.561619 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:30.562062 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:30.562827 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:30.563259 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:30.726731 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:30.736342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:30.738840 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:30.740788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5ce98221-1587-4c26-9f5a-9f5cae1654e0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.190812 Jun 24 10:41:30.752571 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 328/662] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:30 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:30.916159 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-1fca9015-a8b4-460f-be07-57c856b5004d req-21686ee8-442a-4a51-8211-580279200203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "name": "network-vif-plugged", "status": "completed", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:30.927313 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-1fca9015-a8b4-460f-be07-57c856b5004d req-21686ee8-442a-4a51-8211-580279200203 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:30.927884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-1fca9015-a8b4-460f-be07-57c856b5004d req-21686ee8-442a-4a51-8211-580279200203 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:30.942507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-1fca9015-a8b4-460f-be07-57c856b5004d req-21686ee8-442a-4a51-8211-580279200203 service nova] Creating event network-vif-plugged:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:41:30.948489 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-1fca9015-a8b4-460f-be07-57c856b5004d req-21686ee8-442a-4a51-8211-580279200203 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215750 Jun 24 10:41:30.949897 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 335/663] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:41:31.262281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:31.262771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:31.271623 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:31.272068 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:31.272885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:31.273318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:31.316287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-693fc78f-95b7-4b58-b4c4-d0350935539f tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/ips" status: 200 len: 144 microversion: 2.1 time: 0.057932 Jun 24 10:41:31.317479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 329/664] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:41:31 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/ips => generated 144 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:31.761976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:31.762325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:31.776475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:31.776475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:31.776475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:31.776475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:31.952548 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:31.963660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:31.966414 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:31.967984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b510c224-19f1-4c81-b6d7-3cff0df5022a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.211396 Jun 24 10:41:31.979527 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 336/665] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:31 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:32.860624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bd58a6c-d26b-4947-9754-3760e326fb78"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:32.861866 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:32.874903 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:32.875449 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:32.876407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:32.876980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:32.989655 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:33.001291 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:33.018316 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:33.019115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:33.020235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:33.021661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:33.236269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5e0887c7-4083-4163-a518-8d579a9d97cc tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380026 Jun 24 10:41:33.240826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 330/666] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:41:32 2022] POST /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:33.285078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:33.301608 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:33.303109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:33.309885 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-81eac4d9-540d-4c35-850f-51f6c25ab808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.324697 Jun 24 10:41:33.325728 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 337/667] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:32 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:34.336649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:34.338116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:34.349567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:34.350634 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:34.351745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:34.352397 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:34.378401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:34.577811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:34.587214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:34.588989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:34.590419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-909a40a4-d6ed-4c3a-94f0-b03424ed9228 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.260969 Jun 24 10:41:34.591507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 331/668] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:34 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:35.609449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:35.611009 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:35.613654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=29 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.619200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:35.619751 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:35.620621 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:35.621163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:35.624431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=79 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.775659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:35.784134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:35.785931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:35.789558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-bc33ad0a-30d4-4491-b58a-39b954487083 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.184191 Jun 24 10:41:35.790446 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 338/669] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:35 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:36.813079 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:36.814389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:36.821047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:36.822272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:36.823225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:36.823891 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:37.046752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:37.056060 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:37.058129 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:37.059928 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2339ba57-28c3-4adb-b813-efedfa57346b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.255899 Jun 24 10:41:37.060509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 332/670] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:36 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:38.080008 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:38.081182 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:38.089154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:38.089771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:38.090774 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:38.091371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:38.238525 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:38.249288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:38.251289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:38.252713 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6d4454fd-f596-4b7a-a1b1-a857a43ddd54 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.178247 Jun 24 10:41:38.265566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 339/671] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:38 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:39.273868 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:39.274551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:39.278215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=31 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:39.281962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:39.282880 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:39.283733 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:39.284163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:39.425272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:39.435038 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:39.436926 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:39.438299 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e1661947-d0b2-4eb2-8d5c-e5f94c1beb83 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1740 microversion: 2.20 time: 0.168855 Jun 24 10:41:39.439492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 333/672] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:39 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:40.460188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:40.461413 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:40.469867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.470314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.471081 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.471909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.607909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:40.616051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:40.617610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:40.618761 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6eea95b1-8ba0-4da2-9d91-493f295bfcab tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1722 microversion: 2.20 time: 0.164545 Jun 24 10:41:40.619334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 340/673] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:40 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:40.895464 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:40.896418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:40.903245 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.903683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.904453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.904913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.938427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2cd97723-5612-4be2-bcc6-00ec764ab652 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046761 Jun 24 10:41:40.938891 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 334/674] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:41:40 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:40.948761 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:40.949272 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:40.955468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.955924 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.956696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:40.957162 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:40.987220 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-02978f03-d0d5-424b-9ce9-519307e80318 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78" status: 200 len: 194 microversion: 2.1 time: 0.042324 Jun 24 10:41:40.987809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 341/675] 10.222.0.69 () {58 vars in 1412 bytes} [Fri Jun 24 10:41:40 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:41.638181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:41.638799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:41.646895 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:41.647606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:41.648729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:41.649387 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:41.786533 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:41.795413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:41.796988 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:41.798159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-15b8eb6e-a535-460d-bd91-190432cdfa1c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1722 microversion: 2.20 time: 0.164654 Jun 24 10:41:41.798870 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 335/676] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:41 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:42.316216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70013806-90fc-4389-8222-252918d741d1"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:42.317318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:42.323543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:42.323985 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:42.324804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:42.325297 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:42.618693 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1aefb874-e4ec-4463-9639-d7e48ce94d47 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "POST /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306162 Jun 24 10:41:42.619432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 342/677] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:41:42 2022] POST /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:42.743722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-9c94d140-f25c-4e76-93f1-3d0a5cb6a5e8 req-4587ede7-1e1e-49b3-8a3d-4557e1bb718c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "name": "network-vif-unplugged", "status": "completed", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:42.753213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-9c94d140-f25c-4e76-93f1-3d0a5cb6a5e8 req-4587ede7-1e1e-49b3-8a3d-4557e1bb718c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:42.753656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-9c94d140-f25c-4e76-93f1-3d0a5cb6a5e8 req-4587ede7-1e1e-49b3-8a3d-4557e1bb718c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:42.769947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.compute.server_external_events [req-9c94d140-f25c-4e76-93f1-3d0a5cb6a5e8 req-4587ede7-1e1e-49b3-8a3d-4557e1bb718c service nova] Unable to find a host for instance ef17986c-1f72-461f-ad90-a81148f083a9. Dropping event network-vif-unplugged {{(pid=124304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 10:41:42.770838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-9c94d140-f25c-4e76-93f1-3d0a5cb6a5e8 req-4587ede7-1e1e-49b3-8a3d-4557e1bb718c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030963 Jun 24 10:41:42.771607 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 336/678] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 10:41:42.817900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:42.819200 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:42.831218 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:42.831657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:42.832484 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:42.833002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.004973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:43.013652 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:43.015214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:43.016522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-12283606-28de-463d-839a-3573c8d2abd5 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1665 microversion: 2.20 time: 0.204055 Jun 24 10:41:43.017143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 343/679] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:42 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1665 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:43.034952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a6cfa24-a780-4e25-b24e-35b1c0427462"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:43.036035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:43.042517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.042962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.043855 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.044294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.345122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c950dc30-dc97-4760-9053-ff7b9ee94b0e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313655 Jun 24 10:41:43.345863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 337/680] 10.222.0.69 () {62 vars in 1363 bytes} [Fri Jun 24 10:41:43 2022] POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:41:43.465236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:43.466115 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:43.472928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.473370 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.474124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.474562 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.712944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-54555af1-9539-4919-86b5-55c58a482792 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments/8a6cfa24-a780-4e25-b24e-35b1c0427462" status: 202 len: 0 microversion: 2.20 time: 0.251269 Jun 24 10:41:43.713442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 344/681] 10.222.0.69 () {60 vars in 1456 bytes} [Fri Jun 24 10:41:43 2022] DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments/8a6cfa24-a780-4e25-b24e-35b1c0427462 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:41:43.780425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:41:43.781169 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:43.791486 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.791927 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.792714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.793174 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.875765 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-fb93f279-b516-4011-8033-894aa6108c90 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/action" status: 202 len: 0 microversion: 2.20 time: 0.099554 Jun 24 10:41:43.876380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 338/682] 10.222.0.69 () {62 vars in 1318 bytes} [Fri Jun 24 10:41:43 2022] POST /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:41:43.885523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:43.886335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:43.895683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.896341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:43.897383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:43.897825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:44.051841 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:44.060919 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:44.062475 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:44.063653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4cf3e894-b764-4be9-a17f-e1768f4e0d47 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1673 microversion: 2.20 time: 0.182604 Jun 24 10:41:44.064241 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 345/683] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:43 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:45.082786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:45.083685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:45.091999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:45.092450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:45.093256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:45.093689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:45.250716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:45.260773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:45.262761 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:45.264675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-119b70f9-d8ab-4b9b-938c-31d2677be508 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1673 microversion: 2.20 time: 0.186273 Jun 24 10:41:45.265754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 339/684] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:45 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:46.283692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:46.284318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:46.291616 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:46.292066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:46.292910 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:46.293341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:46.440109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:46.453236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:46.455181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:46.456368 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a256920d-cbdb-4927-ac51-a284061bd18a tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.177010 Jun 24 10:41:46.456962 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 346/685] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:46 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:47.475598 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:47.476204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:47.483284 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:47.483721 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:47.484675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:47.485142 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:47.723174 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:47.735950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:47.738935 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:47.740696 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f7e50b1c-5939-4a3b-8402-34460722540b tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.268892 Jun 24 10:41:47.741702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 340/686] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:47 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:48.759214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:48.759899 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:48.767343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:48.767792 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:48.768557 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:48.769009 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:48.947905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:48.956275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:48.957895 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:48.959057 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4e27cd69-b690-4e76-9703-83a299296b80 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.203870 Jun 24 10:41:48.959630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 347/687] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:48 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:49.979463 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:49.980378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:49.987184 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:49.987657 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:49.988428 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:49.988897 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:50.193117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:50.201856 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:50.213839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:50.215054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-398fa986-c8f8-42a1-a03a-c15ac6bd966c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.240099 Jun 24 10:41:50.215625 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 341/688] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:49 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:51.235099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:51.235738 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:51.242956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:51.243489 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:51.244353 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:51.244903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:51.393183 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:51.401067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:51.402581 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:51.403753 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e7d998c4-bc42-4738-8766-f7aef11a43db tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.173003 Jun 24 10:41:51.404314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 348/689] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:51 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:52.422736 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:52.424034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:52.431488 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:52.431944 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:52.432709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:52.433393 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:52.582979 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:52.591239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:52.593547 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:52.595273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8a4d6a70-90dd-46f3-b572-5d4673a06925 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.176650 Jun 24 10:41:52.606023 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 342/690] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:52 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:53.224396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:53.226609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:53.269578 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.271804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.280787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.280787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.350796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:41:53.407430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:53.490646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e18413f8-f55d-4de4-8830-af2ac542ec30 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 204 len: 0 microversion: 2.1 time: 0.275806 Jun 24 10:41:53.491816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 349/691] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:41:53 2022] DELETE /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:41:53.501613 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:53.502245 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:53.509416 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.510044 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.511088 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.511515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.627820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:53.629203 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:53.640782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.645839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.647031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:53.649201 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:53.703271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:53.713507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-05b06402-e0fc-4e9f-b5d5-35edf5f8b40c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1579 microversion: 2.1 time: 0.217112 Jun 24 10:41:53.714191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 343/692] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:53 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1579 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:53.841991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:53.856308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:53.858235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:53.860431 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f6482aa3-27f9-4070-8c8b-13a9100ccbcc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.237254 Jun 24 10:41:53.861039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 350/693] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:53 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:54.731673 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:54.732342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:54.739152 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:54.739594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:54.740355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:54.740776 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:54.879412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:54.881014 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:54.889500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:54.890519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:54.890851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:54.891363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:54.891808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:54.901097 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8bc48e51-23ed-4c8b-9685-7e1c8f683596 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1579 microversion: 2.1 time: 0.173193 Jun 24 10:41:54.902054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 344/694] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:54 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:55.052386 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:55.061723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:55.063845 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:55.065065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a7c7404e-6779-4f70-b5d8-1339ab5704d0 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.189899 Jun 24 10:41:55.075472 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 351/695] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:54 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:55.923635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:55.924810 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:55.935673 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:55.936420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:55.937613 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:55.938056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:55.942171 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:56.082953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:56.083510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:56.084213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:56.090352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:56.090800 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:56.091826 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:56.092033 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-884e42aa-25c8-48ba-ba02-0810933630d5 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1579 microversion: 2.1 time: 0.176025 Jun 24 10:41:56.092251 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:56.092591 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 345/696] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:55 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:56.225101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:56.233370 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:56.234891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:56.236054 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-dc02bc54-2997-4818-80a2-bfaa2455ecbd tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.157099 Jun 24 10:41:56.236602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 352/697] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:56 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:57.114461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:57.115355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:57.126490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:57.127227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:57.128459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:57.129235 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:57.256399 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:57.257097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:57.266600 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:57.267321 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:57.267952 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:57.268535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:57.292105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:57.299703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b4849047-eacd-4b70-903a-dbaa45144660 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1579 microversion: 2.1 time: 0.192215 Jun 24 10:41:57.300497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 346/698] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:57 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:57.402995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:57.412052 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:57.413589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:57.414759 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-03a7468b-2563-42c4-b8fc-547fe00c2187 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.164617 Jun 24 10:41:57.415337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 353/699] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:57 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:58.317134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:58.317764 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:58.324626 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:58.325225 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:58.326006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:58.326507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:58.433746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:58.435098 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:58.443305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:58.443796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:58.444931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:58.445627 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:58.483311 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:58.491752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b14a26c8-72b3-4efc-9ed5-edf8d2b11261 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1579 microversion: 2.1 time: 0.178574 Jun 24 10:41:58.492797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 347/700] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:58 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:58.595438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:58.603493 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:58.605043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:58.606247 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-496281d1-5afb-44b8-ba7d-ed4ad30047eb tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.176577 Jun 24 10:41:58.606786 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 354/701] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:58 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:41:59.511652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:59.512372 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:59.519336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.519883 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.520765 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.521289 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.588403 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:41:59.596872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6205f3d2-1ceb-47e1-b6a0-163b9251fca9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1511 microversion: 2.1 time: 0.089070 Jun 24 10:41:59.597552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 348/702] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:41:59 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:41:59.624887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:59.625491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:59.632646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.633128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.633896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.634331 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.799291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:59.801954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:59.809025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.809557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.810401 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.810905 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:41:59.845434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9c530059-f9a8-447d-a685-b7f1fa36c5f7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049628 Jun 24 10:41:59.848888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 349/703] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:41:59 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:41:59.991180 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:41:59.991664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:41:59.998265 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:41:59.999500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.001104 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.001554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.037115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-125d7d01-f4a0-4d96-b86d-d54644e8b0cd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78" status: 200 len: 194 microversion: 2.1 time: 0.050086 Jun 24 10:42:00.037902 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 350/704] 10.222.0.69 () {58 vars in 1412 bytes} [Fri Jun 24 10:41:59 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:00.047568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:00.048000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:00.054086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.054523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.055315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.055708 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.110396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:00.119560 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:00.121109 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:00.122634 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-585472be-40af-43d6-9b64-60f00a876808 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.501602 Jun 24 10:42:00.123349 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 355/705] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:41:59 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:00.165546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lazy-loading 'services' on Instance uuid 074c1c69-718f-40a6-bacf-98f29f7a33c5 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:42:00.252706 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5e3b7c88-553d-430b-aa7d-a362cfb631d4 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78" status: 202 len: 0 microversion: 2.1 time: 0.209161 Jun 24 10:42:00.253726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 351/706] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:42:00 2022] DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/4bd58a6c-d26b-4947-9754-3760e326fb78 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:42:00.406283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-6aec39f7-6791-45d3-b121-131467cf8d99 req-a1de0944-4e7a-4de4-9bc3-83896c2fcfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef73619d-95e3-4358-a61b-7cbe58f76050", "name": "network-vif-deleted", "tag": "f10fad00-dddc-4bae-9fce-5914b2b2b0ad"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:00.414914 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-6aec39f7-6791-45d3-b121-131467cf8d99 req-a1de0944-4e7a-4de4-9bc3-83896c2fcfd7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.415355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-6aec39f7-6791-45d3-b121-131467cf8d99 req-a1de0944-4e7a-4de4-9bc3-83896c2fcfd7 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.427709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-6aec39f7-6791-45d3-b121-131467cf8d99 req-a1de0944-4e7a-4de4-9bc3-83896c2fcfd7 service nova] Creating event network-vif-deleted:f10fad00-dddc-4bae-9fce-5914b2b2b0ad for instance ef73619d-95e3-4358-a61b-7cbe58f76050 on hv-cinder-84753 Jun 24 10:42:00.432714 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-6aec39f7-6791-45d3-b121-131467cf8d99 req-a1de0944-4e7a-4de4-9bc3-83896c2fcfd7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297277 Jun 24 10:42:00.433449 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 356/707] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:00.616047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:00.617495 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:00.624001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.624553 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.625420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.625911 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.664564 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:00.665047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:00.665523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lazy-loading 'fault' on Instance uuid ef73619d-95e3-4358-a61b-7cbe58f76050 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:42:00.709498 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:00.717190 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a3479132-cf44-47ce-ae25-796b417983eb tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 200 len: 1230 microversion: 2.1 time: 0.106097 Jun 24 10:42:00.717725 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 352/708] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:00 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:01.012425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-cc667ed2-2c5d-4279-9ba4-e0d00b8593f0 req-21adda6d-ace7-41e2-a482-b4e38f3cae62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "name": "network-vif-plugged", "status": "completed", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:01.023856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-cc667ed2-2c5d-4279-9ba4-e0d00b8593f0 req-21adda6d-ace7-41e2-a482-b4e38f3cae62 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.024384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-cc667ed2-2c5d-4279-9ba4-e0d00b8593f0 req-21adda6d-ace7-41e2-a482-b4e38f3cae62 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.038047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-cc667ed2-2c5d-4279-9ba4-e0d00b8593f0 req-21adda6d-ace7-41e2-a482-b4e38f3cae62 service nova] Creating event network-vif-plugged:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:42:01.043436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-cc667ed2-2c5d-4279-9ba4-e0d00b8593f0 req-21adda6d-ace7-41e2-a482-b4e38f3cae62 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Jun 24 10:42:01.044471 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 357/709] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:01.141646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:01.142815 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:01.151021 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.151691 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.154323 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.155198 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.395184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:01.396448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:01.399656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:01.404229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.405751 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.407184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.408235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.415294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:01.416851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:01.418048 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1191f6c6-ce4e-4344-9232-7162c5743447 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.280913 Jun 24 10:42:01.418615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 353/710] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:01 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:01.449079 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-434806f8-05b0-4269-9ad3-481529901caf tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/70013806-90fc-4389-8222-252918d741d1" status: 200 len: 194 microversion: 2.1 time: 0.058925 Jun 24 10:42:01.449713 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 358/711] 10.222.0.69 () {58 vars in 1412 bytes} [Fri Jun 24 10:42:01 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/70013806-90fc-4389-8222-252918d741d1 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:42:01.460526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:01.461068 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:01.467297 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.467746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.468601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.468950 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.553217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lazy-loading 'services' on Instance uuid 074c1c69-718f-40a6-bacf-98f29f7a33c5 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:42:01.644330 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-22d69b98-2b55-4c56-94d6-a99f633200c7 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/70013806-90fc-4389-8222-252918d741d1" status: 202 len: 0 microversion: 2.1 time: 0.188533 Jun 24 10:42:01.645053 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 354/712] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:42:01 2022] DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments/70013806-90fc-4389-8222-252918d741d1 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:42:01.735575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:01.736184 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:01.742906 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.743422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.744279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:01.744958 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:01.760575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] HTTP exception thrown: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Request method failure captured: Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 HTTP/1.1 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZQ0_oiuhyUsufdNkmGXHWA6jANXPIxN0gqzcG_CDZOn51lPsMoVoOTnuAQY_v9PhjGC6zSSFbHDcCJgLwXmw2QVL-pM9WuhUbBPTJIejElW6qYN3ENC4cDUCvNuOMHqrWG0mC81aozbglpP61qGfVEHgfiH3o1hVPasmY5pj_S1LDw Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:42:01.762264 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8eb1e5f40033474c947399c22bb0a2d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-TestVolumeBootPattern-432545666 Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 5fc073d480884782b4084952345382b9 Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:42:01.763869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'ef73619d-95e3-4358-a61b-7cbe58f76050'} Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:01.765141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:42:01.766670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:01.767994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Returning 404 to user: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:01.767994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-015db345-05a6-4874-b082-0c5a3c71522b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 404 len: 111 microversion: 2.1 time: 0.032022 Jun 24 10:42:01.767994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 359/713] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:01 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:01.862257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-159126931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198254431", "security_groups": [{"name": "tempest-secgroup-smoke-1102130013"}], "block_device_mapping_v2": [{"uuid": "abecc1f6-fce2-4765-9ef2-bb5b93a2a307", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3da010b-27ad-4a9f-8afe-32b8ee29d12d"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:01.975489 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] validate_networks() for [('a3da010b-27ad-4a9f-8afe-32b8ee29d12d', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:42:02.439097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:02.439865 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:02.449134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.449569 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.450371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.450839 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.451562 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:42:02.451971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:42:02.452462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:42:02.452898 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:42:02.453301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:42:02.464724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.466110 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.467168 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.467748 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.485938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:42:02.490056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for user 5fc073d480884782b4084952345382b9 and project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:42:02.555948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:42:02.558345 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abecc1f6-fce2-4765-9ef2-bb5b93a2a307',volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:42:02.597237 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:02.606126 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:02.607822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:02.609008 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7a9b3efb-1427-4cd5-94a0-a02838f9de25 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.175669 Jun 24 10:42:02.610432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 360/714] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:02 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:02.709483 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c8e96270-5d97-4f1e-a07d-0ada857752dc tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851619 Jun 24 10:42:02.710443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 355/715] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:42:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:42:02.721396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c7fc1855-1f96-40bf-b163-68dda3affc2d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:02.721968 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c7fc1855-1f96-40bf-b163-68dda3affc2d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:02.804818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c7fc1855-1f96-40bf-b163-68dda3affc2d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:02.811493 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:02.812660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:02.814311 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c7fc1855-1f96-40bf-b163-68dda3affc2d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1093 microversion: 2.1 time: 0.097899 Jun 24 10:42:02.816190 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 361/716] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:02 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:02.820479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.821269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.822229 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:02.822803 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:02.855009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2ac582df-bc6d-49e9-a769-194389f97d3d tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047607 Jun 24 10:42:02.855947 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 356/717] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:42:02 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 10:42:02.996822 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:02.998039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:03.004978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.005406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.006393 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.007037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.044686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c5aa6b45-be74-4b81-8837-91b8edbd5ffd tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052075 Jun 24 10:42:03.045591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 362/718] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:42:02 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:42:03.110618 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:03.111126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:03.118066 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.118512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.119286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.119701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.146070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:42:03.245427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c78ae49f-0fc3-40a7-a60d-e6c52c3e6274 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 204 len: 0 microversion: 2.1 time: 0.138205 Jun 24 10:42:03.248817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 357/719] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:42:03 2022] DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:42:03.255129 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:03.255739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:03.261854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.262284 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.263242 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.263673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.392601 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:03.400558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ca5be8d6-8dc3-4563-9478-30f21ab2e25a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1669 microversion: 2.1 time: 0.149517 Jun 24 10:42:03.401165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 363/720] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:03 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:03.632549 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:03.633733 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:03.644534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.644963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.645717 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.646145 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.791720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:03.800439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:03.801959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:03.803112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9f6a5f8f-4dda-42de-b0c9-d69ae10be2e8 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1731 microversion: 2.20 time: 0.178047 Jun 24 10:42:03.803760 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 358/721] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:03 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:03.832161 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:03.832802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:03.839497 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.839941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.840692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:03.841151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:03.913768 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:03.925987 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6815cfcf-cf21-4d98-b2db-cd9a63e2f07d tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1135 microversion: 2.1 time: 0.097441 Jun 24 10:42:03.926750 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 364/722] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:03 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1135 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:04.422457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:04.423447 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:04.430989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.431428 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.432179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.432605 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.436867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:04.564669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:04.572450 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0d7ae8b4-93e6-49d5-ad77-285b0ba88b0a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1669 microversion: 2.1 time: 0.156773 Jun 24 10:42:04.573055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 359/723] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:04 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:04.821796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:04.822380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:04.828810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.829260 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.830027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.830455 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.948651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:04.949291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:04.956304 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.956781 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.957534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:04.957981 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:04.960654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:04.968946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:04.970774 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:04.971998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7044aabc-4c0e-44f1-af6c-cbba948c687e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1718 microversion: 2.20 time: 0.154418 Jun 24 10:42:04.972554 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 365/724] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:04 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:05.033007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:05.045500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3e437200-41a5-476a-be59-1f54c67110f2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1191 microversion: 2.1 time: 0.100574 Jun 24 10:42:05.046312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 360/725] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:04 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:05.591339 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:05.592246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:05.600789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:05.601555 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:05.602406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:05.602838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:05.694438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '733b7d5058da45089a2133e2fe4695e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41afc594f464d74bd4881e07dd33e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:05.703015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8eaeb762-88db-4dc9-81a3-39316e23c541 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 200 len: 1603 microversion: 2.1 time: 0.116105 Jun 24 10:42:05.704517 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 366/726] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:05 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 1603 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:06.032910 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-840143d4-65d8-496e-9de8-097ffe581660 req-e25c518b-ae4d-4047-9b45-254b8cf21540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074c1c69-718f-40a6-bacf-98f29f7a33c5", "name": "network-vif-deleted", "tag": "9f634125-4668-43db-831a-285df3eb2a83"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:06.062748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:06.063457 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:06.069568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:06.074959 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.075399 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.076196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.076596 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.079494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-840143d4-65d8-496e-9de8-097ffe581660 req-e25c518b-ae4d-4047-9b45-254b8cf21540 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.080037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-840143d4-65d8-496e-9de8-097ffe581660 req-e25c518b-ae4d-4047-9b45-254b8cf21540 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.149784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-840143d4-65d8-496e-9de8-097ffe581660 req-e25c518b-ae4d-4047-9b45-254b8cf21540 service nova] Creating event network-vif-deleted:9f634125-4668-43db-831a-285df3eb2a83 for instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 on hv-cinder-84753 Jun 24 10:42:06.165355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-840143d4-65d8-496e-9de8-097ffe581660 req-e25c518b-ae4d-4047-9b45-254b8cf21540 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140168 Jun 24 10:42:06.166797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 361/727] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:42:06.301319 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:06.315014 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e0897064-79d5-4a4a-8f1b-dff2a2c6ddff tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.256373 Jun 24 10:42:06.316669 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 367/728] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:06 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:06.721228 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:06.722485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:06.730816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.731394 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.732433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.733319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.750809 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 HTTP/1.1 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:06.752814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:06.754497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '074c1c69-718f-40a6-bacf-98f29f7a33c5'} Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:06.756019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:06.757239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:06.759619 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:06.760690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4ac6e8f2-edd3-4be5-a29f-a76589c76bf0 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 404 len: 111 microversion: 2.1 time: 0.044466 Jun 24 10:42:06.761505 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 362/729] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:06 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:06.771611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a56d70c6-0837-4c41-bf4d-af5f27d4fa4a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '.version_select at 0x7f17628b6160>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:06.799816 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a56d70c6-0837-4c41-bf4d-af5f27d4fa4a tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731491973" status: 202 len: 0 microversion: 2.1 time: 0.033207 Jun 24 10:42:06.800437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 368/730] 10.222.0.69 () {58 vars in 1217 bytes} [Fri Jun 24 10:42:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731491973 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:42:06.931243 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-c47dc329-ba64-437c-a126-ba2ff5b68197 req-42187ce0-b056-4542-9ba7-fdb8215a1e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343e6a2c-4912-4c03-8c30-7221f2ed02ef", "tag": "dc5718e5-e015-401c-99c6-e54a9611e82f"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:06.955397 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c47dc329-ba64-437c-a126-ba2ff5b68197 req-42187ce0-b056-4542-9ba7-fdb8215a1e9f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:06.955979 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c47dc329-ba64-437c-a126-ba2ff5b68197 req-42187ce0-b056-4542-9ba7-fdb8215a1e9f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:06.977959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-c47dc329-ba64-437c-a126-ba2ff5b68197 req-42187ce0-b056-4542-9ba7-fdb8215a1e9f service nova] Creating event network-changed:dc5718e5-e015-401c-99c6-e54a9611e82f for instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef on hv-cinder-84753 Jun 24 10:42:06.989151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-c47dc329-ba64-437c-a126-ba2ff5b68197 req-42187ce0-b056-4542-9ba7-fdb8215a1e9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176634 Jun 24 10:42:06.994173 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 363/731] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:07.335933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:07.336867 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:07.345312 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:07.345766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:07.346636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:07.346981 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:07.577306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:07.580803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:07.588809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-37ebdcf9-be54-4d89-a067-41ce68c07258 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.259606 Jun 24 10:42:07.589699 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 369/732] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:07 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:08.612222 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:08.613383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:08.623922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:08.624656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:08.625956 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:08.626663 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:08.766237 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:08.773752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9d00bb74-dd06-4457-a33f-2d60402f807c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.169407 Jun 24 10:42:08.774639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 364/733] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:08 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:09.796374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:09.797248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:09.806022 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.806467 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.807213 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.807643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.888873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:09.889340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:09.891854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:09.898080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.898522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.899286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.899682 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.915600 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 HTTP/1.1 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:09.917294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.918758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '074c1c69-718f-40a6-bacf-98f29f7a33c5'} Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:09.919485 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.920837 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.922150 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:09.922150 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-901ac099-ec88-4edf-a878-82f3d94d6d68 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 404 len: 111 microversion: 2.1 time: 0.033724 Jun 24 10:42:09.922633 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 365/734] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:42:09 2022] DELETE /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:09.927366 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:09.928009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 074c1c69-718f-40a6-bacf-98f29f7a33c5] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:09.934137 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.934581 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.935419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:09.935880 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:09.946263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:09.949687 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 HTTP/1.1 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:09.951206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.952714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '074c1c69-718f-40a6-bacf-98f29f7a33c5'} Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:09.953621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. Jun 24 10:42:09.955034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:09.956207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 074c1c69-718f-40a6-bacf-98f29f7a33c5 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:09.956207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2ed1c743-9f2f-4e24-b573-d3aa6c50bdff tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jun 24 10:42:09.956365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 366/735] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:09 2022] GET /compute/v2.1/servers/074c1c69-718f-40a6-bacf-98f29f7a33c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:09.956933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c1cc9b0c-9ba6-449e-aaeb-fa523eebdec1 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.168262 Jun 24 10:42:09.957581 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 370/736] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:09 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:10.978344 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:10.979386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:10.990458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:10.991257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:10.992008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:10.992433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:11.090860 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:11.091389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:11.098488 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:11.098936 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:11.099745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:11.100176 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:11.114467 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 HTTP/1.1 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:42:11.116541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.117976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '332b01da-30de-4466-9408-485f644e52f7'} Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:11.118668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.119869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.121146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:11.121146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8d852147-be29-4215-9518-1517136f1314 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 404 len: 111 microversion: 2.1 time: 0.030974 Jun 24 10:42:11.121146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 371/737] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:42:11 2022] DELETE /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:11.127124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:11.127819 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] [instance: 332b01da-30de-4466-9408-485f644e52f7] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:11.133546 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:11.134145 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:11.134592 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:11.135362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:11.135793 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:11.141058 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ba1409d5-7413-4991-9b95-36132b3e1308 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.169714 Jun 24 10:42:11.141622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 367/738] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:10 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:11.149547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] HTTP exception thrown: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Request method failure captured: Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 HTTP/1.1 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN1E6vzxR-OR0-zRsmSAF3rlOBkMiko7qQQPHAQKDRLtlIHClLT3z4ZT_BzrdnQAjrR6XkFstVFYm2BNHJWCpYPtJWHnvp-NW6FREDiYwQA4dW0GD0OieVKujFL_Irh1QQ9oq2Vg6zhp4qTGde8uoqsQaRErbQpd-RZJxItHS0Ll8c Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:42:11.151065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e41afc594f464d74bd4881e07dd33e45", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e41afc594f464d74bd4881e07dd33e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e41afc594f464d74bd4881e07dd33e45 Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-741836218 Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 733b7d5058da45089a2133e2fe4695e7 Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeTestJSON-741836218-project Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.152580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '332b01da-30de-4466-9408-485f644e52f7'} Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:11.153387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. Jun 24 10:42:11.154506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:11.155551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] Returning 404 to user: Instance 332b01da-30de-4466-9408-485f644e52f7 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:11.155551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-63d2776f-878d-42ce-b3bd-a0063ed79f52 tempest-AttachVolumeTestJSON-741836218 tempest-AttachVolumeTestJSON-741836218-project] 10.222.0.69 "GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7" status: 404 len: 111 microversion: 2.1 time: 0.029123 Jun 24 10:42:11.155551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 372/739] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:11 2022] GET /compute/v2.1/servers/332b01da-30de-4466-9408-485f644e52f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:12.158861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:12.159472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:12.165970 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:12.166417 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:12.167201 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:12.167619 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:12.404705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:12.414811 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-94a1b2a3-c6f2-40a3-ae5b-3123d503ac2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.259800 Jun 24 10:42:12.415383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 368/740] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:12 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:13.431649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:13.432390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:13.434998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:13.447650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:13.448093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:13.448905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:13.449389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:13.732327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:13.740389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9c62b369-9679-4341-b1f8-3743b71ca98f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.312675 Jun 24 10:42:13.741111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 373/741] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:13 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:14.758945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:14.760293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:14.765051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:14.766001 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:14.774022 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:14.774561 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:14.775446 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:14.776078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:14.977959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:14.985540 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e35463c9-68f4-4329-a8a1-6bddbd99a424 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.231570 Jun 24 10:42:14.986087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 369/742] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:14 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:16.002243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:16.002855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:16.009795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:16.010155 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:16.010971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:16.011328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:16.144143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:16.152002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6a16134d-141f-4c8b-ac9a-19b9a0e1a160 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.153576 Jun 24 10:42:16.152807 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 374/743] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:15 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:16.876996 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-249de705-9961-4d09-8616-6373eda55b5f req-9cb9db4c-78df-49f4-870f-7b1d2deaa15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343e6a2c-4912-4c03-8c30-7221f2ed02ef", "name": "network-vif-plugged", "status": "completed", "tag": "dc5718e5-e015-401c-99c6-e54a9611e82f"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:16.886632 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-249de705-9961-4d09-8616-6373eda55b5f req-9cb9db4c-78df-49f4-870f-7b1d2deaa15a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:16.887145 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-249de705-9961-4d09-8616-6373eda55b5f req-9cb9db4c-78df-49f4-870f-7b1d2deaa15a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:16.902575 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-249de705-9961-4d09-8616-6373eda55b5f req-9cb9db4c-78df-49f4-870f-7b1d2deaa15a service nova] Creating event network-vif-plugged:dc5718e5-e015-401c-99c6-e54a9611e82f for instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef on hv-cinder-84753 Jun 24 10:42:16.908343 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-249de705-9961-4d09-8616-6373eda55b5f req-9cb9db4c-78df-49f4-870f-7b1d2deaa15a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Jun 24 10:42:16.909147 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 370/744] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:17.169689 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:17.170292 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:17.180620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:17.183114 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:17.183928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:17.184363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:17.337866 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:17.347848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8cdcb989-9591-4e2a-9482-15e56c3cb5e6 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.182425 Jun 24 10:42:17.349976 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 375/745] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:17 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:18.371537 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:18.371537 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:18.374179 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:18.374605 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:18.375361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:18.375785 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:18.523565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:18.531240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2c66b7f2-900e-44d0-941f-b5c7f9a135b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1265 microversion: 2.1 time: 0.169024 Jun 24 10:42:18.531989 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 371/746] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:18 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:19.548120 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:19.548958 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:19.560966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:19.560966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:19.560966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:19.560966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:19.694223 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:19.702174 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-12f50444-a617-43f8-a554-913127c5636f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1452 microversion: 2.1 time: 0.158032 Jun 24 10:42:19.702748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 376/747] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:19 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:19.719262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:19.719798 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:19.726612 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:19.727177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:19.727768 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:19.728199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:19.876703 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:19.884399 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ea7f8947-d640-4a48-be38-b5cb14b36b63 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1452 microversion: 2.1 time: 0.169140 Jun 24 10:42:19.884948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 372/748] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:19 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:21.506664 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-07d1850b-0a5a-409b-aa79-57417ccbe2e6 req-803f6510-2ead-4558-947b-5e3861a8abbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343e6a2c-4912-4c03-8c30-7221f2ed02ef", "tag": "dc5718e5-e015-401c-99c6-e54a9611e82f"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:21.515664 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-07d1850b-0a5a-409b-aa79-57417ccbe2e6 req-803f6510-2ead-4558-947b-5e3861a8abbb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:21.516104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-07d1850b-0a5a-409b-aa79-57417ccbe2e6 req-803f6510-2ead-4558-947b-5e3861a8abbb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:21.528568 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-07d1850b-0a5a-409b-aa79-57417ccbe2e6 req-803f6510-2ead-4558-947b-5e3861a8abbb service nova] Creating event network-changed:dc5718e5-e015-401c-99c6-e54a9611e82f for instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef on hv-cinder-84753 Jun 24 10:42:21.533686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-07d1850b-0a5a-409b-aa79-57417ccbe2e6 req-803f6510-2ead-4558-947b-5e3861a8abbb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030748 Jun 24 10:42:21.534635 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 377/749] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:36.054777 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:36.055720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:36.058609 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=15 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.059435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=58 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.065324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.065759 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.066526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.066965 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.098015 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f638029a-a194-4b65-8a4e-29de9cae92bf tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047272 Jun 24 10:42:36.098586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 373/750] 10.222.0.69 () {60 vars in 1342 bytes} [Fri Jun 24 10:42:36 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:36.156207 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.157033 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=36 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.161376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:36.162830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:36.170366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.170812 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.171578 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.171997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.197937 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:42:36.283482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4469691b-3d5c-4f6d-9b54-48ad952576e6 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 204 len: 0 microversion: 2.20 time: 0.128548 Jun 24 10:42:36.284258 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 378/751] 10.222.0.69 () {60 vars in 1279 bytes} [Fri Jun 24 10:42:36 2022] DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:42:36.292821 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:36.293668 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:36.320213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.320701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.321561 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:36.322008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:36.476490 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:36.485136 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:36.486612 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:36.487971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e8d3f853-2028-4cf9-b16b-86584b3c3f3e tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.199027 Jun 24 10:42:36.488549 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 374/752] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:36 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:37.507764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:37.509039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:37.515891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:37.516338 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:37.517134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:37.517558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:37.657178 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:37.665646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:37.667132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:37.669050 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4ca0335a-9624-4366-a975-bd2d5d239621 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1724 microversion: 2.20 time: 0.165975 Jun 24 10:42:37.669597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 379/753] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:37 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:38.688383 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:38.688957 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:38.696414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:38.696889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:38.697643 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:38.698238 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:38.779765 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:38.789309 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:38.790814 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e4ed08c1c81453abaa6c1dd826f0258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281651371cba4d4a9454b0747947cc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:38.791986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-075cb9d9-df5e-4ed4-a9a5-b79a5754545c tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 200 len: 1656 microversion: 2.20 time: 0.108093 Jun 24 10:42:38.792758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 375/754] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:38 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:42:38.865681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-05e8c857-faf5-43a7-9f92-6b46418de2cc req-2c1fabfa-9bba-4c97-bbd4-d0439b7495c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef17986c-1f72-461f-ad90-a81148f083a9", "name": "network-vif-deleted", "tag": "ddc7ea5d-9bef-4578-8f64-88c270cc0ec2"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:38.882744 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-05e8c857-faf5-43a7-9f92-6b46418de2cc req-2c1fabfa-9bba-4c97-bbd4-d0439b7495c0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:38.883578 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-05e8c857-faf5-43a7-9f92-6b46418de2cc req-2c1fabfa-9bba-4c97-bbd4-d0439b7495c0 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:38.897407 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-05e8c857-faf5-43a7-9f92-6b46418de2cc req-2c1fabfa-9bba-4c97-bbd4-d0439b7495c0 service nova] Creating event network-vif-deleted:ddc7ea5d-9bef-4578-8f64-88c270cc0ec2 for instance ef17986c-1f72-461f-ad90-a81148f083a9 on hv-cinder-84753 Jun 24 10:42:38.903915 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-05e8c857-faf5-43a7-9f92-6b46418de2cc req-2c1fabfa-9bba-4c97-bbd4-d0439b7495c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041804 Jun 24 10:42:38.904961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 380/755] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:39.811963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:39.812701 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:39.819287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:39.819799 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:39.820563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:39.821016 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:39.834802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 HTTP/1.1 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:39.836608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:39.838072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'ef17986c-1f72-461f-ad90-a81148f083a9'} Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:39.838884 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:39.840151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:39.841411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:39.841411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7f2b5421-5abf-4238-a39d-bef8365407a4 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 404 len: 111 microversion: 2.20 time: 0.030627 Jun 24 10:42:39.841411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 376/756] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:39 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:42:39.849671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-117d9402-0614-49e0-b2d1-0de70e55eddc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '.version_select at 0x7f17627ca670>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:39.870611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-117d9402-0614-49e0-b2d1-0de70e55eddc tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259635867" status: 204 len: 0 microversion: 2.20 time: 0.026508 Jun 24 10:42:39.871297 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 381/757] 10.222.0.69 () {60 vars in 1261 bytes} [Fri Jun 24 10:42:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259635867 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:42:41.675511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:41.676019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:41.682429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:41.682876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:41.683646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:41.684071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:41.697851 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 HTTP/1.1 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:41.699411 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.700995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'ef17986c-1f72-461f-ad90-a81148f083a9'} Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:41.701912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.703398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.704646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:41.704646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e2acfc76-90d2-43ed-9c47-78b575b68050 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 404 len: 111 microversion: 2.20 time: 0.029734 Jun 24 10:42:41.704646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 377/758] 10.222.0.69 () {60 vars in 1279 bytes} [Fri Jun 24 10:42:41 2022] DELETE /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:42:41.710031 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:41.710806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: ef17986c-1f72-461f-ad90-a81148f083a9] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:41.717424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:41.717871 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:41.718739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:41.719147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:41.732971 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 HTTP/1.1 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:42:41.734674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.736229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'ef17986c-1f72-461f-ad90-a81148f083a9'} Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:41.737225 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. Jun 24 10:42:41.738602 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:41.740018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance ef17986c-1f72-461f-ad90-a81148f083a9 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:41.740018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f4202cc7-b82c-453b-a2d8-07a0d3569026 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9" status: 404 len: 111 microversion: 2.20 time: 0.030528 Jun 24 10:42:41.740018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 382/759] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:41 2022] GET /compute/v2.1/servers/ef17986c-1f72-461f-ad90-a81148f083a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:42:45.008791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:45.009338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:45.016587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:45.017055 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:45.017813 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:45.018244 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:45.032542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a HTTP/1.1 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:42:45.034109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.035507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '2d906fe1-2729-458e-8564-c4ba21b2767a'} Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:45.036215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.037646 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.039293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:45.039293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9ee40ba9-c0f1-4f48-ad56-b8340c645b2d tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 404 len: 111 microversion: 2.20 time: 0.030869 Jun 24 10:42:45.039293 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 378/760] 10.222.0.69 () {60 vars in 1279 bytes} [Fri Jun 24 10:42:45 2022] DELETE /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:42:45.043934 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:45.044514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] [instance: 2d906fe1-2729-458e-8564-c4ba21b2767a] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:45.051771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:45.052215 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:45.053010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:45.053436 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:45.067148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] HTTP exception thrown: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Request method failure captured: Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a HTTP/1.1 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZN-OXFOU0z57gnZahEzq9gHPemJlT-60_d80XqV-MIbADRK5kXvUbKmRzaiwTrm8goG1HvTlLV6slW2Sr7LpNjl7Hkj36iN3j1Ty7SJ5CajW1Co6O-_2X6pO6oANJFrvQiFAy2EOe33rzSovrbDKolbip1fpkueO4Rmwjyeg5j3I2c Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:42:45.068697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_281651371cba4d4a9454b0747947cc83", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/281651371cba4d4a9454b0747947cc83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/281651371cba4d4a9454b0747947cc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 281651371cba4d4a9454b0747947cc83 Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637015948 Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 3e4ed08c1c81453abaa6c1dd826f0258 Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637015948-project Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.070306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '2d906fe1-2729-458e-8564-c4ba21b2767a'} Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:42:45.071305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. Jun 24 10:42:45.072429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:42:45.073478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] Returning 404 to user: Instance 2d906fe1-2729-458e-8564-c4ba21b2767a could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:42:45.073478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4212cc13-21a5-4717-8296-c779b23c7840 tempest-AttachVolumeShelveTestJSON-1637015948 tempest-AttachVolumeShelveTestJSON-1637015948-project] 10.222.0.69 "GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a" status: 404 len: 111 microversion: 2.20 time: 0.030058 Jun 24 10:42:45.073478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 383/761] 10.222.0.69 () {60 vars in 1276 bytes} [Fri Jun 24 10:42:45 2022] GET /compute/v2.1/servers/2d906fe1-2729-458e-8564-c4ba21b2767a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:42:53.825291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f1adca3b-8eec-4ced-89de-68b24818cbe2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: .version_select at 0x7f1767192c10>, body: {"keypair": {"name": "tempest-keypair-287499413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBEaYk9rpTAH8z98Qx0tjSxpCTiAxvEOMkdcL+0X7kQ4kKK03iTtOzkSki2zA+xoLWkZv1aMmVH2RjDeJZ6gV1SQFkJmDIYqDnlI00AHspz7EqKDe69VKWCRQibefH11w=="}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:53.842854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-f1adca3b-8eec-4ced-89de-68b24818cbe2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:42:53.848341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-f1adca3b-8eec-4ced-89de-68b24818cbe2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:42:53.875971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f1adca3b-8eec-4ced-89de-68b24818cbe2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190454 Jun 24 10:42:53.876985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 379/762] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:42:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:55.279717 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-224664160", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d21023a8-a179-44ed-9a96-27e103b0914f"}], "security_groups": [{"name": "tempest-securitygroup--559514916"}], "key_name": "tempest-keypair-287499413", "user_data": "}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:55.286802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:55.287451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:55.392691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] validate_networks() for [('d21023a8-a179-44ed-9a96-27e103b0914f', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:42:55.822648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:42:55.823196 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:42:55.823665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:42:55.824063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:42:55.824459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:42:55.833490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:55.833931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:55.834897 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:55.835308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:55.852230 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:42:55.856181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:42:55.867483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:42:55.869803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:42:55.919445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-33ca1e9a-a86b-4f33-934e-87156107d5b0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644378 Jun 24 10:42:55.920392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 384/763] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:42:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:42:55.930545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2396cfe0-d9f8-4c67-9c36-184eaf5278a6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:55.931909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2396cfe0-d9f8-4c67-9c36-184eaf5278a6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:55.934538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=24 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:55.992315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2396cfe0-d9f8-4c67-9c36-184eaf5278a6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:55.998987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2396cfe0-d9f8-4c67-9c36-184eaf5278a6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1240 microversion: 2.1 time: 0.072399 Jun 24 10:42:56.000833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 380/764] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:55 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:57.016554 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:57.017350 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:57.024631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:57.025173 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:57.031691 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:57.032148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:57.116939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:57.125599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6e00b446-9c56-4b26-8aeb-a21715d28b0e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1300 microversion: 2.1 time: 0.113766 Jun 24 10:42:57.126944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 385/765] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:57 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:58.143527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:58.144135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:58.150924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:58.151365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:58.152102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:58.152761 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:58.409710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:58.418962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cb6d2976-4f34-495c-ba50-64b4f0e33be8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.279304 Jun 24 10:42:58.420908 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 381/766] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:58 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:42:58.586152 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-874dcda5-d60a-400b-a434-45cd06c10230 req-f918bd05-ad73-4143-86f4-221ec4f69c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a463b3-7cdc-4aa4-b822-bc800a37d402", "tag": "05f0634c-a530-498b-a8f6-9601bb19f124"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:42:58.598267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-874dcda5-d60a-400b-a434-45cd06c10230 req-f918bd05-ad73-4143-86f4-221ec4f69c53 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:58.598944 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-874dcda5-d60a-400b-a434-45cd06c10230 req-f918bd05-ad73-4143-86f4-221ec4f69c53 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:58.611493 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-874dcda5-d60a-400b-a434-45cd06c10230 req-f918bd05-ad73-4143-86f4-221ec4f69c53 service nova] Creating event network-changed:05f0634c-a530-498b-a8f6-9601bb19f124 for instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 on hv-cinder-84753 Jun 24 10:42:58.616904 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-874dcda5-d60a-400b-a434-45cd06c10230 req-f918bd05-ad73-4143-86f4-221ec4f69c53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034551 Jun 24 10:42:58.617802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 386/767] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:42:59.437743 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:42:59.438290 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:42:59.445500 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:59.446312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:59.447086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:42:59.447520 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:42:59.660025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:42:59.667741 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8ef667f5-7894-45d1-8e99-3a4ae6eca1a7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.234092 Jun 24 10:42:59.668327 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 382/768] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:42:59 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:00.685773 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:00.686790 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:00.693979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:00.694486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:00.695269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:00.695723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:00.921784 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:00.929570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-98d6e2bb-4743-4455-8d5b-dca1eb64a69a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.248671 Jun 24 10:43:00.930746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 387/769] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:00 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:01.948117 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:01.948833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:01.957243 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:01.957847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:01.959241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:01.959843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:02.130006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:02.138338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-80960eec-5b23-4319-853b-e92b639df200 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.194736 Jun 24 10:43:02.139192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 383/770] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:01 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:03.155692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:03.157003 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:03.164188 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:03.165131 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:03.166038 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:03.166751 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:03.360928 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:03.369273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9181f28e-9a86-4bdb-b7ab-9b5c4aff5429 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.217330 Jun 24 10:43:03.370307 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 388/771] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:03 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:03.876106 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f9042b50-4907-4fc7-b2ea-b9f8f02e60c7 req-9254c950-c3bc-4418-b19e-d46cf86a532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a463b3-7cdc-4aa4-b822-bc800a37d402", "name": "network-vif-plugged", "status": "completed", "tag": "05f0634c-a530-498b-a8f6-9601bb19f124"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:03.886997 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f9042b50-4907-4fc7-b2ea-b9f8f02e60c7 req-9254c950-c3bc-4418-b19e-d46cf86a532c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:03.887460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f9042b50-4907-4fc7-b2ea-b9f8f02e60c7 req-9254c950-c3bc-4418-b19e-d46cf86a532c service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:03.903153 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f9042b50-4907-4fc7-b2ea-b9f8f02e60c7 req-9254c950-c3bc-4418-b19e-d46cf86a532c service nova] Creating event network-vif-plugged:05f0634c-a530-498b-a8f6-9601bb19f124 for instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 on hv-cinder-84753 Jun 24 10:43:03.912077 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f9042b50-4907-4fc7-b2ea-b9f8f02e60c7 req-9254c950-c3bc-4418-b19e-d46cf86a532c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040309 Jun 24 10:43:03.913005 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 384/772] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:04.387221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:04.387745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:04.394979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:04.395495 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:04.396486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:04.397039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:04.556041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:04.565391 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-71ba19db-4389-4509-bf6b-170c5186ded8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1365 microversion: 2.1 time: 0.182095 Jun 24 10:43:04.566137 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 389/773] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:04 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:05.583439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:05.585000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:05.593384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:05.594270 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:05.595308 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:05.596193 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:05.743689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:05.752595 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8bc4277f-f888-4e3d-b7e7-6a1823c4ac51 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1554 microversion: 2.1 time: 0.173998 Jun 24 10:43:05.753312 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 385/774] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:05 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:05.771880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:05.772378 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:05.781036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:05.783282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:05.785389 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:05.786011 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:05.841492 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:05.864434 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:05.889423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f9311a5f-e230-4e59-8d74-820a088c236e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122514 Jun 24 10:43:05.889941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 390/775] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:43:05 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:07.302845 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-7e62075b-2dc8-473f-a3a9-69852e5b90f0 req-1aa62021-9a0a-4300-a6c0-67c8832d8db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a463b3-7cdc-4aa4-b822-bc800a37d402", "tag": "05f0634c-a530-498b-a8f6-9601bb19f124"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:07.313112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:07.315551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:07.318280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-7e62075b-2dc8-473f-a3a9-69852e5b90f0 req-1aa62021-9a0a-4300-a6c0-67c8832d8db5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:07.318966 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-7e62075b-2dc8-473f-a3a9-69852e5b90f0 req-1aa62021-9a0a-4300-a6c0-67c8832d8db5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:07.344206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-7e62075b-2dc8-473f-a3a9-69852e5b90f0 req-1aa62021-9a0a-4300-a6c0-67c8832d8db5 service nova] Creating event network-changed:05f0634c-a530-498b-a8f6-9601bb19f124 for instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 on hv-cinder-84753 Jun 24 10:43:07.361854 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-7e62075b-2dc8-473f-a3a9-69852e5b90f0 req-1aa62021-9a0a-4300-a6c0-67c8832d8db5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063796 Jun 24 10:43:07.366524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 386/776] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:18.954143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.954939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=32 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.961023 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9450f5fd-8dc4-4732-99ec-49cda4a0b75f tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'create', calling method: .version_select at 0x7f176286fe50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-496602068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExR7IHikoDy5JGl3D1j9STAMJI5XKbmxGbXB28nMBBz3AmutZbW2DfpmRmfLzBC4QCMTRMhGNuofuNTmFKpKA6BHS/s6qTRM+vc6GlxBF3QgLnDnjl4AGMSZ5PHKwU3pw=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:18.979692 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-9450f5fd-8dc4-4732-99ec-49cda4a0b75f tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Getting quotas for project c2ca2c1ee6294b2fb8020ea0b1d73d72. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:43:18.984401 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-9450f5fd-8dc4-4732-99ec-49cda4a0b75f tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Getting quotas for user 08dfca461f9947c08f885161891deb10 and project c2ca2c1ee6294b2fb8020ea0b1d73d72. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:43:19.012658 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9450f5fd-8dc4-4732-99ec-49cda4a0b75f tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060158 Jun 24 10:43:19.013599 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 391/777] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:43:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:19.065134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=28 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:19.069913 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-988756491", "imageRef": "5dd6f17e-4b2b-4f26-8e5e-02051a1c6d44", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-496602068", "networks": [{"uuid": "02e1b34a-7e54-4c0d-a3d9-f57fa0cd936d"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:19.121653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] validate_networks() for [('02e1b34a-7e54-4c0d-a3d9-f57fa0cd936d', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:43:19.511574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:43:19.511999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:43:19.512449 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:43:19.512875 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:43:19.513281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:43:19.523541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:19.523992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:19.524807 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:19.525256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:19.542524 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Getting quotas for project c2ca2c1ee6294b2fb8020ea0b1d73d72. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:43:19.546568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Getting quotas for user 08dfca461f9947c08f885161891deb10 and project c2ca2c1ee6294b2fb8020ea0b1d73d72. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:43:19.558392 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:43:19.560762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5dd6f17e-4b2b-4f26-8e5e-02051a1c6d44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:43:19.607932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6dfd5b7a-c443-4013-9235-34792584452b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544337 Jun 24 10:43:19.608583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 387/778] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:43:19.619167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a7e581d4-2ff6-43e7-ab3c-31a33815550a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:19.619880 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a7e581d4-2ff6-43e7-ab3c-31a33815550a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:19.673743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a7e581d4-2ff6-43e7-ab3c-31a33815550a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:19.680645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a7e581d4-2ff6-43e7-ab3c-31a33815550a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1257 microversion: 2.1 time: 0.065567 Jun 24 10:43:19.681325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 392/779] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:19 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:20.698962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:20.700214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:20.708260 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:20.708705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:20.710574 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:20.711110 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:20.780769 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:20.790075 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5773c334-f5f2-4488-bbfc-83849adc941b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1327 microversion: 2.1 time: 0.095980 Jun 24 10:43:20.790656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 388/780] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:20 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:21.807510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:21.808053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:21.817130 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:21.817585 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:21.818354 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:21.818791 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:22.228982 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:22.236629 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-904ef93b-6ef4-412d-b238-0a5a6472d4d7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.433086 Jun 24 10:43:22.237261 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 393/781] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:21 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:23.252907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:23.253514 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:23.261582 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:23.262032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:23.262790 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:23.263186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:23.409005 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:23.416978 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-97f55de4-ec28-4883-8092-9b105b08aa36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.167898 Jun 24 10:43:23.417552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 389/782] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:23 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:24.435216 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:24.435933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:24.442965 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:24.443404 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:24.444169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:24.444589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:24.587470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:24.598025 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1fd66afc-b3dd-4e6f-81c4-6daa6121a315 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.167542 Jun 24 10:43:24.598796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 394/783] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:24 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:25.615424 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:25.616031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:25.627382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:25.627828 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:25.628602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:25.629065 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:25.767848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:25.773824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-efecc28d-1ada-413f-85a3-550bd5040b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.162364 Jun 24 10:43:25.774560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 390/784] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:25 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:26.791875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:26.792482 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:26.799575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:26.800024 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:26.800861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:26.801295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:26.985210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:26.993290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3e380441-a444-4faf-a0b5-04c99f297a18 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.205989 Jun 24 10:43:26.994086 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 395/785] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:26 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:28.011850 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:28.012467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:28.019214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:28.019848 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:28.020620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:28.021092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:28.155242 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:28.162809 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ecdfa913-0a9e-4c64-8177-45a87980e07a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.155028 Jun 24 10:43:28.163423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 391/786] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:28 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:29.180631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:29.181372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:29.188977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:29.189508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:29.190356 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:29.190879 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:29.332249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:29.340000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a9cc08d0-6c7a-474f-8db0-6d440ebc6568 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.163404 Jun 24 10:43:29.340579 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 396/787] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:29 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:30.358946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:30.359570 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:30.361937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.362608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:30.368901 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:30.369345 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:30.370460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:30.370938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:30.510211 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:30.518080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-65e03a63-4556-4a3f-86c6-c505d6ba061b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.163198 Jun 24 10:43:30.518649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 392/788] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:30 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:31.052465 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-fa683880-c89a-4cd0-bc3b-35e42c622b81 req-723c4064-4b75-4f52-849e-168dcd296184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:31.062442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:31.068589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-fa683880-c89a-4cd0-bc3b-35e42c622b81 req-723c4064-4b75-4f52-849e-168dcd296184 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:31.069388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-fa683880-c89a-4cd0-bc3b-35e42c622b81 req-723c4064-4b75-4f52-849e-168dcd296184 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:31.087000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-fa683880-c89a-4cd0-bc3b-35e42c622b81 req-723c4064-4b75-4f52-849e-168dcd296184 service nova] Creating event network-changed:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:43:31.091935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-fa683880-c89a-4cd0-bc3b-35e42c622b81 req-723c4064-4b75-4f52-849e-168dcd296184 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043169 Jun 24 10:43:31.092547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 397/789] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:31.535363 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:31.535972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:31.542972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:31.543418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:31.544180 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:31.544608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:31.676762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:31.684641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-084998ad-6e22-4daf-8247-f834ab5e492a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.153435 Jun 24 10:43:31.685445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 393/790] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:31 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:32.702902 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:32.703598 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:32.710303 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:32.710756 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:32.711523 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:32.711953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:32.849564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:32.857874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-84444e6d-ce12-4d8d-b901-088e6af770c8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.159801 Jun 24 10:43:32.858459 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 398/791] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:32 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:33.875280 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:33.875896 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:33.882497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:33.882946 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:33.884120 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:33.884549 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:34.020071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:34.032254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c959b3a3-190b-4729-a9a3-ea78dfa76472 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.160777 Jun 24 10:43:34.033010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 394/792] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:33 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:35.054158 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:35.055113 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:35.063468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:35.063917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:35.064668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:35.065135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:35.199945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:35.209315 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9c9e0fc9-27ff-4e79-92ea-192a4566820e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.161518 Jun 24 10:43:35.210119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 399/793] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:35 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:35.502948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-e401ceeb-024c-4757-b527-26f2b211ad16 req-ea74c431-68e2-4c5b-a76f-066e99026bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "name": "network-vif-plugged", "status": "completed", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:35.514101 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-e401ceeb-024c-4757-b527-26f2b211ad16 req-ea74c431-68e2-4c5b-a76f-066e99026bb6 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:35.514549 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-e401ceeb-024c-4757-b527-26f2b211ad16 req-ea74c431-68e2-4c5b-a76f-066e99026bb6 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:35.525840 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-e401ceeb-024c-4757-b527-26f2b211ad16 req-ea74c431-68e2-4c5b-a76f-066e99026bb6 service nova] Creating event network-vif-plugged:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:43:35.530821 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-e401ceeb-024c-4757-b527-26f2b211ad16 req-ea74c431-68e2-4c5b-a76f-066e99026bb6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032900 Jun 24 10:43:35.531426 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 395/794] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:36.233448 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:36.234185 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:36.242617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:36.243172 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:36.244119 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:36.244659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:36.381917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:36.393830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5ceebfef-f6a3-45aa-8fba-13374ee6bbb4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1357 microversion: 2.1 time: 0.166026 Jun 24 10:43:36.394661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 400/795] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:36 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:37.417389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:37.418776 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:37.425138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.425586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:37.426333 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.426756 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:37.562750 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:37.570425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7b36c71c-9ea5-4911-9d8e-1ad604d55c72 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1547 microversion: 2.1 time: 0.160837 Jun 24 10:43:37.570990 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 396/796] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:37 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:37.586808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:37.587413 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:37.594093 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.594529 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:37.595277 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.595704 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:37.731078 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:37.738978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a6a52573-b2d1-42c3-bc39-603da79d85b2 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1547 microversion: 2.1 time: 0.156096 Jun 24 10:43:37.739544 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 401/797] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:37 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:37.754757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:37.758149 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:37.758909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Searching by: {'deleted': False, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72'} {{(pid=124304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 10:43:37.765857 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.766301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:37.767122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:37.767548 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:38.013379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.multi_cell_list [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 10:43:38.108665 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f2f17054-8ad2-442e-88d2-e542cb7bdc4e tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.357596 Jun 24 10:43:38.109427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 397/798] 10.222.0.69 () {58 vars in 1124 bytes} [Fri Jun 24 10:43:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:38.124382 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:38.125101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:38.131231 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:38.131645 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:38.132397 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:38.132854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:38.266745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:38.274519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-92551e86-5a2f-4562-a591-253eb4c66db1 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1547 microversion: 2.1 time: 0.154976 Jun 24 10:43:38.275092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 402/799] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:38 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:39.833365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:39.834436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:39.841993 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:39.842441 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:39.843205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:39.843637 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:40.112641 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-628b6dc1-7639-4633-8bd1-28ec25ff7381 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283130 Jun 24 10:43:40.113283 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 398/800] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:43:39 2022] POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:42.152920 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:42.154163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:42.165074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:42.165810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:42.167053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:42.167759 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:42.191477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4926a44b-c06b-48f2-85e4-8f968e41835f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/ips" status: 200 len: 149 microversion: 2.1 time: 0.045057 Jun 24 10:43:42.192065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 403/801] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:43:42 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:43.559192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "175a5f4e-e9f9-4263-85b5-2d2bc5c76586"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:43.560427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:43.579163 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:43.579584 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:43.580355 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:43.580780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:43.868512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-0f116e68-1053-4cbd-9c76-f0e4e5ac21a3 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314219 Jun 24 10:43:43.869296 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 399/802] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:43:43 2022] POST /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:46.640037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:46.640680 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:46.647817 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:46.648268 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:46.649049 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:46.649483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:46.789549 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:46.798143 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2a3481b7-1976-46f3-bd1c-5c09d1b44f10 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1593 microversion: 2.1 time: 0.162112 Jun 24 10:43:46.798688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 404/803] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:46 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:48.540026 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:48.547726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-189016a2-56c3-4a70-8385-311e80faf2f7 req-3badb84a-154f-448f-8157-6e5517d9ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:48.562442 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-189016a2-56c3-4a70-8385-311e80faf2f7 req-3badb84a-154f-448f-8157-6e5517d9ecc5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:48.562967 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-189016a2-56c3-4a70-8385-311e80faf2f7 req-3badb84a-154f-448f-8157-6e5517d9ecc5 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:48.574650 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-189016a2-56c3-4a70-8385-311e80faf2f7 req-3badb84a-154f-448f-8157-6e5517d9ecc5 service nova] Creating event network-changed:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:43:48.582522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-189016a2-56c3-4a70-8385-311e80faf2f7 req-3badb84a-154f-448f-8157-6e5517d9ecc5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043643 Jun 24 10:43:48.583410 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 400/804] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:49.551393 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1731931838"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:49.551988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:49.554886 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:49.560903 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:49.561352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:49.562125 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:49.562795 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:49.566294 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=67 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:49.695133 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.network.security_group_api [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Adding security group d361f4ee-86b5-42f0-b035-45a830422599 to port 8f5ac905-2e34-4d60-a69f-39b37fc56415 Jun 24 10:43:50.076847 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a8a97884-67bc-4564-bc6b-032e73caeef8 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action" status: 202 len: 0 microversion: 2.1 time: 0.529288 Jun 24 10:43:50.080571 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 405/805] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:43:49 2022] POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:43:50.086364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:50.087162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:50.090116 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-5399bb2f-d22d-4ca6-8779-227790df6682 req-64ad5dd8-6ce1-4dd9-85d2-ff6e627e7c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:50.090997 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:50.103118 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:50.103785 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:50.103908 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-5399bb2f-d22d-4ca6-8779-227790df6682 req-64ad5dd8-6ce1-4dd9-85d2-ff6e627e7c5e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:50.104768 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-5399bb2f-d22d-4ca6-8779-227790df6682 req-64ad5dd8-6ce1-4dd9-85d2-ff6e627e7c5e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:50.105032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:50.105615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:50.121380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-5399bb2f-d22d-4ca6-8779-227790df6682 req-64ad5dd8-6ce1-4dd9-85d2-ff6e627e7c5e service nova] Creating event network-changed:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:43:50.123288 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:50.129001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-5399bb2f-d22d-4ca6-8779-227790df6682 req-64ad5dd8-6ce1-4dd9-85d2-ff6e627e7c5e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045077 Jun 24 10:43:50.129769 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 406/806] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:50.292508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:50.302052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-78acb529-497e-4c7a-919f-258152ddd0f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1759 microversion: 2.1 time: 0.219985 Jun 24 10:43:50.304931 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 401/807] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:50 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1759 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:53.549367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-4c5eef46-5453-4b9b-b07c-a4a288b88f07 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: .version_select at 0x7f1762831550>, body: {"keypair": {"name": "tempest-keypair-1283800352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPt1pAfoa/LWK6t7RAenRsSEYEhXFz+Xum2WWyz4REBpJ+yiXAISoGy/T/3JZI0WgJaIkMS3B66LbZ/Elc/DFHCCohZHef2UDiFCaxDv2/TkaBe6f3O8Sm0fXy4hnm6daQ=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:53.565041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-4c5eef46-5453-4b9b-b07c-a4a288b88f07 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:43:53.569456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-4c5eef46-5453-4b9b-b07c-a4a288b88f07 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:43:53.595657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-4c5eef46-5453-4b9b-b07c-a4a288b88f07 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051322 Jun 24 10:43:53.596582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 407/808] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:43:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:54.906350 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521087148", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d21023a8-a179-44ed-9a96-27e103b0914f"}], "security_groups": [{"name": "tempest-securitygroup--56322628"}], "key_name": "tempest-keypair-1283800352", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:55.019632 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] validate_networks() for [('d21023a8-a179-44ed-9a96-27e103b0914f', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:43:55.412471 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:43:55.413102 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:43:55.413660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:43:55.414224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:43:55.414839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:43:55.425251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:55.425689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:55.426501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:55.426932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:55.444545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:43:55.449125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:43:55.461006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:43:55.463263 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:43:55.512276 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-4191d4b4-ac56-4ec4-b7e2-d43625f4e882 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.610291 Jun 24 10:43:55.513407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 402/809] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:43:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:43:55.523833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-277d1b80-60df-4160-9ae3-712bf809f46e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:55.524648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-277d1b80-60df-4160-9ae3-712bf809f46e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:55.581099 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-277d1b80-60df-4160-9ae3-712bf809f46e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:55.587856 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-277d1b80-60df-4160-9ae3-712bf809f46e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1242 microversion: 2.1 time: 0.068567 Jun 24 10:43:55.588429 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 408/810] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:55 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:56.605632 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:56.606221 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:56.613362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:56.613794 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:56.614552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:56.615731 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:56.683051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:56.691435 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a7220c4d-94d1-4aef-8c13-5af146a6251d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1302 microversion: 2.1 time: 0.090372 Jun 24 10:43:56.692050 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 403/811] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:56 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:57.711447 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:57.712086 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:57.722938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:57.723583 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:57.724708 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:57.725405 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:57.860491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:57.868210 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-11bbc43f-d10b-42a7-857f-7ae0330def0b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.162814 Jun 24 10:43:57.868773 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 409/812] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:57 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:43:58.250937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-28c0e029-25e0-4108-8f5f-aa43638d4a33 req-2653072e-2596-4cae-be6f-9d3d3a959a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d092f4-611c-4983-96aa-dd1bf771f4c1", "tag": "2758a7dd-b498-49b7-bf66-db51545ea829"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:43:58.265326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-28c0e029-25e0-4108-8f5f-aa43638d4a33 req-2653072e-2596-4cae-be6f-9d3d3a959a08 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:58.265830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-28c0e029-25e0-4108-8f5f-aa43638d4a33 req-2653072e-2596-4cae-be6f-9d3d3a959a08 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:58.280649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-28c0e029-25e0-4108-8f5f-aa43638d4a33 req-2653072e-2596-4cae-be6f-9d3d3a959a08 service nova] Creating event network-changed:2758a7dd-b498-49b7-bf66-db51545ea829 for instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 on hv-cinder-84753 Jun 24 10:43:58.286182 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-28c0e029-25e0-4108-8f5f-aa43638d4a33 req-2653072e-2596-4cae-be6f-9d3d3a959a08 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039952 Jun 24 10:43:58.286758 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 404/813] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:43:58.889896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:43:58.890730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:43:58.901885 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:58.902615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:58.903941 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:43:58.904499 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:43:59.046163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:43:59.054309 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a23d64ea-788e-4192-89ee-94b5bbca7c17 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.171074 Jun 24 10:43:59.054886 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 410/814] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:43:58 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:00.077273 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:00.077836 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:00.085122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:00.085592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:00.086385 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:00.086841 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:00.231255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:00.239628 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-783e9808-e994-4bbe-92dd-4ce387d9c7ce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.170030 Jun 24 10:44:00.240199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 405/815] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:00 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:01.260633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:01.261801 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:01.272789 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:01.273541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:01.274798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:01.275562 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:01.406993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:01.414661 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-313614f9-412f-4044-8daa-d5b45d321bea tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.160488 Jun 24 10:44:01.415242 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 411/816] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:01 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:02.436213 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:02.437331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:02.448364 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:02.449160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:02.450550 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:02.451350 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:02.589620 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:02.598071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-144fb5e7-cb76-4601-b3bf-22c3ded30839 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.168452 Jun 24 10:44:02.598667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 406/817] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:02 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:03.616034 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:03.616931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:03.629059 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:03.629660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:03.630470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:03.630905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:03.666190 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-5bbb0885-2f15-4eaf-bea7-539e810f667f req-bf825c84-7c02-45fc-b62b-6f292c7f793b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d092f4-611c-4983-96aa-dd1bf771f4c1", "name": "network-vif-plugged", "status": "completed", "tag": "2758a7dd-b498-49b7-bf66-db51545ea829"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:03.677317 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-5bbb0885-2f15-4eaf-bea7-539e810f667f req-bf825c84-7c02-45fc-b62b-6f292c7f793b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:03.677939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-5bbb0885-2f15-4eaf-bea7-539e810f667f req-bf825c84-7c02-45fc-b62b-6f292c7f793b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:03.692256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-5bbb0885-2f15-4eaf-bea7-539e810f667f req-bf825c84-7c02-45fc-b62b-6f292c7f793b service nova] Creating event network-vif-plugged:2758a7dd-b498-49b7-bf66-db51545ea829 for instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 on hv-cinder-84753 Jun 24 10:44:03.698039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-5bbb0885-2f15-4eaf-bea7-539e810f667f req-bf825c84-7c02-45fc-b62b-6f292c7f793b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Jun 24 10:44:03.698625 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 407/818] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:03.799006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:03.806522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cb035a1a-095c-4629-b867-faaa621f1a4b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.194997 Jun 24 10:44:03.807111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 412/819] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:03 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:04.823890 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:04.824832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:04.831726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:04.832257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:04.833266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:04.833762 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:04.986399 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:04.994105 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-765ab660-7683-4aa8-8542-174549d327a1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.174956 Jun 24 10:44:04.994680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 408/820] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:04 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:06.013788 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:06.014374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:06.016881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:06.022460 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:06.022900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:06.023654 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:06.024080 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:06.171338 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:06.179170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-48b4daf4-0a8a-4249-b6b7-0deb9e79d041 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.171006 Jun 24 10:44:06.179736 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 413/821] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:06 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:07.200232 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:07.201292 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:07.204391 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:07.205521 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:07.217002 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:07.217458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:07.218223 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:07.218664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:07.350482 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:07.358085 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6f3b5724-5283-4ca7-8cf1-40478a81c206 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1366 microversion: 2.1 time: 0.164291 Jun 24 10:44:07.358660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 409/822] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:07 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:08.374878 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:08.376383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:08.382977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:08.383415 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:08.384179 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:08.384619 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:08.515262 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:08.523268 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5ebb1466-a8a5-4ad6-8c9c-54aefbfb937c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1555 microversion: 2.1 time: 0.152173 Jun 24 10:44:08.523848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 414/823] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:08 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:08.540056 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:08.540603 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:08.547192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:08.547660 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:08.548413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:08.548871 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:08.633862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bfd4f858-0eac-4218-aed4-9da7626e4a79 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097393 Jun 24 10:44:08.634732 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 410/824] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:44:08 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:09.604124 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-f216c4f7-509a-4392-b6fa-2e363eb4f668 req-66ad63fa-9e9b-43e5-818f-610b0b15a249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d092f4-611c-4983-96aa-dd1bf771f4c1", "tag": "2758a7dd-b498-49b7-bf66-db51545ea829"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:09.612781 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f216c4f7-509a-4392-b6fa-2e363eb4f668 req-66ad63fa-9e9b-43e5-818f-610b0b15a249 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:09.613246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f216c4f7-509a-4392-b6fa-2e363eb4f668 req-66ad63fa-9e9b-43e5-818f-610b0b15a249 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:09.624435 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-f216c4f7-509a-4392-b6fa-2e363eb4f668 req-66ad63fa-9e9b-43e5-818f-610b0b15a249 service nova] Creating event network-changed:2758a7dd-b498-49b7-bf66-db51545ea829 for instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 on hv-cinder-84753 Jun 24 10:44:09.629725 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-f216c4f7-509a-4392-b6fa-2e363eb4f668 req-66ad63fa-9e9b-43e5-818f-610b0b15a249 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029312 Jun 24 10:44:09.630382 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 415/825] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:11.695134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1700167185", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198254431", "security_groups": [{"name": "tempest-secgroup-smoke-1102130013"}], "block_device_mapping_v2": [{"uuid": "e4a6e898-d2c2-45fd-9da3-6cfb557d398f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3da010b-27ad-4a9f-8afe-32b8ee29d12d"}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:11.807334 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] validate_networks() for [('a3da010b-27ad-4a9f-8afe-32b8ee29d12d', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:44:12.196527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:44:12.197007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:44:12.197472 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:44:12.197869 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:44:12.198266 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:44:12.208508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:12.208986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:12.209781 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:12.210206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:12.227994 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:44:12.232386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Getting quotas for user 5fc073d480884782b4084952345382b9 and project 8eb1e5f40033474c947399c22bb0a2d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:44:12.292116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:44:12.294274 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4a6e898-d2c2-45fd-9da3-6cfb557d398f',volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:44:12.441692 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d531c1ee-74a1-4efc-9795-69cc26c9770a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750923 Jun 24 10:44:12.442505 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 411/826] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:44:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:44:12.453491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e7650f23-bcb2-4604-b46c-904c86b6c91f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:12.454201 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e7650f23-bcb2-4604-b46c-904c86b6c91f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:12.516507 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e7650f23-bcb2-4604-b46c-904c86b6c91f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:12.524522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e7650f23-bcb2-4604-b46c-904c86b6c91f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1094 microversion: 2.1 time: 0.075690 Jun 24 10:44:12.525443 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 416/827] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:12 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:13.543325 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:13.544167 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:13.552675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:13.552675 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:13.553438 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:13.554004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:13.898664 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:13.906211 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c379ba32-ba91-434c-88de-c5d3fcd085ae tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1210 microversion: 2.1 time: 0.367290 Jun 24 10:44:13.906903 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 412/828] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:13 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1210 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:14.799478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-461ddc27-c23d-443e-a75f-1a032093310d req-eae02fe4-6fa9-4325-b751-19b7f2ac8876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a3bcc3-9c26-4e57-b324-3e2028efa880", "tag": "10d4b61f-852d-4fcc-98ad-381d69879ca4"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:14.822376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-461ddc27-c23d-443e-a75f-1a032093310d req-eae02fe4-6fa9-4325-b751-19b7f2ac8876 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:14.822893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-461ddc27-c23d-443e-a75f-1a032093310d req-eae02fe4-6fa9-4325-b751-19b7f2ac8876 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:14.835697 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-461ddc27-c23d-443e-a75f-1a032093310d req-eae02fe4-6fa9-4325-b751-19b7f2ac8876 service nova] Creating event network-changed:10d4b61f-852d-4fcc-98ad-381d69879ca4 for instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 on hv-cinder-84753 Jun 24 10:44:14.841139 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-461ddc27-c23d-443e-a75f-1a032093310d req-eae02fe4-6fa9-4325-b751-19b7f2ac8876 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048897 Jun 24 10:44:14.841833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 417/829] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:14.925253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:14.925849 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:14.932906 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:14.933654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:14.934631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:14.935067 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:15.073681 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:15.081484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-51a24be8-c45a-4cc8-8cd4-53d8c9fd42b0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.160459 Jun 24 10:44:15.082061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 413/830] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:14 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:16.100135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:16.100887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:16.108770 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:16.109310 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:16.110189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:16.110777 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:16.245327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:16.253494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f75a6be5-48f7-44dc-996d-77756ad14f2b tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.158583 Jun 24 10:44:16.254073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 418/831] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:16 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:17.274793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:17.275724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:17.287809 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:17.288557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:17.289868 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:17.290582 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:17.426257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:17.438294 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5cd2155e-18fb-4da4-b0b8-2d221a7998e0 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.170020 Jun 24 10:44:17.439007 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 414/832] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:17 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:18.460155 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:18.462030 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:18.472559 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:18.473053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:18.473807 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:18.474243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:18.613961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:18.622010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-60fecaae-a05b-42ea-bfa2-49799b8b901c tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.169137 Jun 24 10:44:18.622802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 419/833] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:18 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:19.562697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:19.564508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:19.575503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.576235 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.577511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.578233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.640223 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:19.640938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:19.643637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:19.649936 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.650479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.651279 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.651863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.655310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-92de8af9-b3ff-4f5c-a17f-4300fa130b96 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action" status: 202 len: 0 microversion: 2.1 time: 0.099797 Jun 24 10:44:19.659651 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 415/834] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:44:19 2022] POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:44:19.659806 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=58 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:19.665822 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:19.665921 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:19.672311 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.672932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.673694 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:19.674113 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:19.853881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:19.862750 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e035f9da-c5ac-4865-981d-37b7ced1fc61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.226600 Jun 24 10:44:19.863378 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 420/835] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:19 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:19.880043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:19.888199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d9778485-b527-4cb1-afb1-7e795db7cbf4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1751 microversion: 2.1 time: 0.227220 Jun 24 10:44:19.888907 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 416/836] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:19 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:44:20.884369 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:20.885374 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:20.894948 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:20.895390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:20.896147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:20.896570 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:20.905889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:20.906493 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:20.909024 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:20.914755 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:20.915192 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:20.915937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:20.916357 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:20.920062 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:21.098511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:21.106226 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-7b69e23b-a650-4a40-b50d-b8bcbf4c2455 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.228309 Jun 24 10:44:21.106877 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 421/837] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:20 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:21.118493 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:21.126886 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1395a0b3-41f1-47db-ae9a-792d151b3084 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.224720 Jun 24 10:44:21.127467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 417/838] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:20 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:44:22.122825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:22.123455 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:22.130291 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:22.130730 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:22.131477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:22.132106 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:22.148951 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:22.149562 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:22.157806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:22.158652 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:22.160032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:22.160487 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:22.216583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:22.239766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:22.340163 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:22.348227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b4fb53be-4566-490a-a9f8-834f157bcd61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.229409 Jun 24 10:44:22.357337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 422/839] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:22 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:22.357642 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:22.362816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-11753280-c39e-4fe8-a20c-00d36f579c38 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.217912 Jun 24 10:44:22.363389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 418/840] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:22 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:23.365726 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:23.366335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:23.368296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:23.374397 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:23.374875 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:23.375644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:23.376236 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:23.379698 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:23.380305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:23.387145 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:23.387583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:23.388350 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:23.388779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:23.580589 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:23.588421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b499899b-9eda-4186-bd52-9aaff6a56dc9 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.226579 Jun 24 10:44:23.589029 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 423/841] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:23 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:23.595643 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:23.604380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-96ceccdc-5dc1-4789-8a41-0236f7c779bb tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.228666 Jun 24 10:44:23.605133 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 419/842] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:23 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:23.758502 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-c270eab6-6450-46cc-bd93-2eb8ccd1144f req-febd330e-4e94-49ce-989f-780c2525477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a3bcc3-9c26-4e57-b324-3e2028efa880", "name": "network-vif-plugged", "status": "completed", "tag": "10d4b61f-852d-4fcc-98ad-381d69879ca4"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:23.766948 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c270eab6-6450-46cc-bd93-2eb8ccd1144f req-febd330e-4e94-49ce-989f-780c2525477f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:23.767855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-c270eab6-6450-46cc-bd93-2eb8ccd1144f req-febd330e-4e94-49ce-989f-780c2525477f service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:23.780047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-c270eab6-6450-46cc-bd93-2eb8ccd1144f req-febd330e-4e94-49ce-989f-780c2525477f service nova] Creating event network-vif-plugged:10d4b61f-852d-4fcc-98ad-381d69879ca4 for instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 on hv-cinder-84753 Jun 24 10:44:23.785455 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-c270eab6-6450-46cc-bd93-2eb8ccd1144f req-febd330e-4e94-49ce-989f-780c2525477f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Jun 24 10:44:23.786067 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 424/843] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:24.606507 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:24.607078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:24.614475 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:24.616257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:24.616257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:24.616257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:24.622579 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:24.623373 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:24.629876 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:24.630322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:24.631092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:24.631519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:24.816492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:24.824319 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-af4ce60a-2556-4ac3-9f80-b5704e0dc183 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1266 microversion: 2.1 time: 0.221928 Jun 24 10:44:24.824924 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 420/844] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:24 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:24.831295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:24.839551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-09a88fe0-08a4-4e87-aee4-56a654082041 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.221676 Jun 24 10:44:24.840131 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 425/845] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:24 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:25.845430 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:25.846096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:25.854861 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:25.855306 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:25.856197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:25.856428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:25.856922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:25.857073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:25.863693 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:25.864142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:25.864939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:25.865358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:26.058937 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:26.067300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d83a28f0-7f5e-4136-9660-dd8fa5a32a61 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1454 microversion: 2.1 time: 0.228101 Jun 24 10:44:26.068029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 421/846] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:25 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1454 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:26.069504 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:26.080759 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ddc1244c-5368-4f60-a8f5-0da756cbca4c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.228226 Jun 24 10:44:26.081328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 426/847] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:25 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:26.086919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:26.087520 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:26.093709 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:26.094155 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:26.094915 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:26.095348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:26.239448 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:26.247678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-81449781-76d3-48d1-b9f4-49abb38f8754 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1454 microversion: 2.1 time: 0.164535 Jun 24 10:44:26.248257 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 422/848] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:26 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:27.098742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:27.099334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:27.106547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:27.106984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:27.107745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:27.108170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:27.356659 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:27.365406 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-71bdfb2a-b6ae-43c6-90b4-c47faa3fd1ed tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.271112 Jun 24 10:44:27.365988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 427/849] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:27 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:28.058611 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-a3cdb53a-764a-4496-b012-2ebad015b06b req-41223609-aa2c-4793-a60f-05f63f443fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a3bcc3-9c26-4e57-b324-3e2028efa880", "tag": "10d4b61f-852d-4fcc-98ad-381d69879ca4"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:28.067160 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-a3cdb53a-764a-4496-b012-2ebad015b06b req-41223609-aa2c-4793-a60f-05f63f443fad service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:28.067864 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-a3cdb53a-764a-4496-b012-2ebad015b06b req-41223609-aa2c-4793-a60f-05f63f443fad service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:28.081231 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-a3cdb53a-764a-4496-b012-2ebad015b06b req-41223609-aa2c-4793-a60f-05f63f443fad service nova] Creating event network-changed:10d4b61f-852d-4fcc-98ad-381d69879ca4 for instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 on hv-cinder-84753 Jun 24 10:44:28.086267 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-a3cdb53a-764a-4496-b012-2ebad015b06b req-41223609-aa2c-4793-a60f-05f63f443fad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031455 Jun 24 10:44:28.086864 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 423/850] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:28.382693 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:28.384052 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:28.391170 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:28.391979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:28.392766 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:28.393199 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:28.551309 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:28.559980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d5bf3c47-a161-4dbb-9a84-606d60f652f7 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.181078 Jun 24 10:44:28.560665 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 428/851] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:28 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:29.578407 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:29.579094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:29.585991 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:29.586437 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:29.587169 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:29.587589 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:29.749176 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:29.757585 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7478c539-d5b0-4345-b8f4-5f06f856d8bf tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.183960 Jun 24 10:44:29.758162 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 424/852] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:29 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:30.779242 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:30.780243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:30.791388 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:30.792128 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:30.793441 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:30.794138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:30.938731 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:30.947642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a44d57b0-8ffc-437d-8332-93d7abacd722 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.175028 Jun 24 10:44:30.948222 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 429/853] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:30 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:44:31.965576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:31.966277 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:31.974809 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:31.975248 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:31.976004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:31.976434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:32.140032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:32.151617 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a41466a9-e3c1-49e4-bb3c-4c8dfce11421 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.190390 Jun 24 10:44:32.152441 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 425/854] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:31 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:33.173411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:33.174452 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:33.185874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:33.186632 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:33.187881 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:33.188604 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:33.337887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:33.346327 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ed58a62e-de4b-440d-bfdc-52e3f22757fe tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.179578 Jun 24 10:44:33.347282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 430/855] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:33 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:34.363972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:34.364594 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:34.371750 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:34.372191 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:34.372992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:34.373423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:34.519602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:34.528031 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1c5a073d-2d18-4fa8-b3c5-8ea8e117e451 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.168137 Jun 24 10:44:34.528614 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 426/856] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:34 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:35.549675 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:35.550590 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:35.562147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:35.562882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:35.564094 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:35.564863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:35.714980 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:35.726262 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0b814abd-71b8-44b9-b1f3-2a84e703aa09 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1756 microversion: 2.1 time: 0.183174 Jun 24 10:44:35.726869 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 431/857] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:35 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:36.743832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:36.744445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:36.751818 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:36.752262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:36.753121 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:36.753563 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:36.906892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:36.916556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d5b32972-d694-4bf3-a8d2-bfdbd8e74b33 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1759 microversion: 2.1 time: 0.176755 Jun 24 10:44:36.917185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 427/858] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:36 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:45.467818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:45.468362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:45.475956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.476394 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.477267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.477698 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.511423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c505f99d-9d13-4959-bea9-21a3d8b7d212 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.047285 Jun 24 10:44:45.512097 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 432/859] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:44:45 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:45.525621 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "175a5f4e-e9f9-4263-85b5-2d2bc5c76586"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:45.526679 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:45.533889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.534331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.535091 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.535552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.617503 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: POST /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/os-volume_attachments HTTP/1.1 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 74 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:44:45.619241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {"volumeAttachment": {"volumeId": "175a5f4e-e9f9-4263-85b5-2d2bc5c76586"}} Jun 24 10:44:45.620683 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'server_id': 'b9d092f4-611c-4983-96aa-dd1bf771f4c1', 'body': {'volumeAttachment': {'volumeId': '175a5f4e-e9f9-4263-85b5-2d2bc5c76586'}}} Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:45.621565 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:45.623045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 400 to user: Invalid volume: volume 175a5f4e-e9f9-4263-85b5-2d2bc5c76586 is already attached to instances: 03a463b3-7cdc-4aa4-b822-bc800a37d402 {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-86fa7304-bae9-480b-b02b-8a06c1bebfe0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099514 Jun 24 10:44:45.624599 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 428/860] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:44:45 2022] POST /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:44:45.629611 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:45.630105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:45.636855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.637300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.638037 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.638473 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.663235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:44:45.747336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-11fce73e-f2b0-460d-8087-3d1fda7cd07e tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 204 len: 0 microversion: 2.1 time: 0.120857 Jun 24 10:44:45.748263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 433/861] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:44:45 2022] DELETE /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:44:45.758625 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:45.759227 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:45.766128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.766557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.767313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:45.767738 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:45.908729 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:45.916496 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b5641343-d4d5-4a79-b4bb-0ce1c6ff44a5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1680 microversion: 2.1 time: 0.163141 Jun 24 10:44:45.917095 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 429/862] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:45 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:46.938105 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:46.939166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:46.949977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:46.950674 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:46.951873 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:46.952530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:47.093545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:47.106065 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-25257d3c-8037-4adc-80f2-b87b5b7bd985 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1680 microversion: 2.1 time: 0.174504 Jun 24 10:44:47.106914 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 434/863] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:46 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:48.127493 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:48.128156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:48.134847 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:48.135286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:48.136046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:48.136474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:48.204071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:48.214719 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-adbce993-9ac5-465f-a9fa-fa0b59dac6ac tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 200 len: 1614 microversion: 2.1 time: 0.091146 Jun 24 10:44:48.217272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 430/864] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:48 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:48.219519 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-db1000a4-41f6-4988-b455-dd52c7921185 req-96621c4e-c2c3-45c0-844c-20d10ed1d4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d092f4-611c-4983-96aa-dd1bf771f4c1", "name": "network-vif-deleted", "tag": "2758a7dd-b498-49b7-bf66-db51545ea829"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:48.229847 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-db1000a4-41f6-4988-b455-dd52c7921185 req-96621c4e-c2c3-45c0-844c-20d10ed1d4a6 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:48.230295 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-db1000a4-41f6-4988-b455-dd52c7921185 req-96621c4e-c2c3-45c0-844c-20d10ed1d4a6 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:48.404932 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-db1000a4-41f6-4988-b455-dd52c7921185 req-96621c4e-c2c3-45c0-844c-20d10ed1d4a6 service nova] Creating event network-vif-deleted:2758a7dd-b498-49b7-bf66-db51545ea829 for instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 on hv-cinder-84753 Jun 24 10:44:48.409986 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-db1000a4-41f6-4988-b455-dd52c7921185 req-96621c4e-c2c3-45c0-844c-20d10ed1d4a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197566 Jun 24 10:44:48.410855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 435/865] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:49.232720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:49.233454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:49.242025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:49.242554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:49.243351 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:49.243793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:49.259224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 HTTP/1.1 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:44:49.260792 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:44:49.262200 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'b9d092f4-611c-4983-96aa-dd1bf771f4c1'} Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:44:49.262952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:44:49.264580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:49.265740 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:44:49.265740 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-58ac9b78-018a-4101-a119-37a0049690c7 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 404 len: 111 microversion: 2.1 time: 0.033399 Jun 24 10:44:49.266659 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 431/866] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:49 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:44:49.273053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-72dc7abc-d2a8-43c7-8fb7-575a43a0c5ad tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '.version_select at 0x7f17627d9820>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:49.292193 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-72dc7abc-d2a8-43c7-8fb7-575a43a0c5ad tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283800352" status: 202 len: 0 microversion: 2.1 time: 0.023907 Jun 24 10:44:49.292787 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 436/867] 10.222.0.69 () {58 vars in 1220 bytes} [Fri Jun 24 10:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283800352 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:44:50.291580 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:50.292037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:50.298626 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:50.299061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:50.299850 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:50.300262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:50.395602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lazy-loading 'services' on Instance uuid 03a463b3-7cdc-4aa4-b822-bc800a37d402 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:44:50.479382 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-517d45f4-6563-4968-8313-6876cfafc94d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments/175a5f4e-e9f9-4263-85b5-2d2bc5c76586" status: 202 len: 0 microversion: 2.1 time: 0.192854 Jun 24 10:44:50.479972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 432/868] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:44:50 2022] DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments/175a5f4e-e9f9-4263-85b5-2d2bc5c76586 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:44:50.490827 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:50.492186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:50.495073 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:50.500758 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:50.501267 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:50.502131 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:50.502581 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:50.508351 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:50.538829 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0d4792c8-c72a-4c25-91d1-5dfd33b19504 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052143 Jun 24 10:44:50.539391 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 437/869] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:44:50 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:51.555362 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:51.556423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:51.558406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=32 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:51.564552 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.565115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.566004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.566437 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.568948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:51.598054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f1b50218-9a81-45a2-9ad2-c94e72c42c02 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049475 Jun 24 10:44:51.598629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 433/870] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:44:51 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:44:51.662769 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:51.663318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:51.670360 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.670802 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.671547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.671972 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.696747 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:44:51.785613 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9bde018e-b6d5-4239-b274-7f3112478b19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 204 len: 0 microversion: 2.1 time: 0.126621 Jun 24 10:44:51.786206 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 438/871] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:44:51 2022] DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:44:51.794379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:51.794980 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:51.801063 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.801497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.802207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:51.802629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:51.940610 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:51.948789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-83d9d140-96d3-41cf-809e-0706806cb9ee tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1679 microversion: 2.1 time: 0.158204 Jun 24 10:44:51.949379 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 434/872] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:51 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:52.967551 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:52.968258 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:52.975803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:52.976853 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:52.977636 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:52.978074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:53.117678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:53.125686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a17f6d01-6462-4d68-bfbc-b06e9e54756c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1679 microversion: 2.1 time: 0.162601 Jun 24 10:44:53.126276 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 439/873] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:52 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:54.142479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:54.143090 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:54.149942 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:54.150380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:54.151138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:54.151592 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:54.218393 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:54.227584 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-dfe53bf4-2975-4715-94c0-d74b1dacb2e9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 200 len: 1612 microversion: 2.1 time: 0.088267 Jun 24 10:44:54.228205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 435/874] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:54 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:54.395275 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-28a3679b-6aa3-4b21-9cc5-317a8d26ea86 req-41e7949f-8275-4a11-90bb-76800781934b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a463b3-7cdc-4aa4-b822-bc800a37d402", "name": "network-vif-deleted", "tag": "05f0634c-a530-498b-a8f6-9601bb19f124"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:54.406586 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-28a3679b-6aa3-4b21-9cc5-317a8d26ea86 req-41e7949f-8275-4a11-90bb-76800781934b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:54.407383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-28a3679b-6aa3-4b21-9cc5-317a8d26ea86 req-41e7949f-8275-4a11-90bb-76800781934b service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:54.420249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-28a3679b-6aa3-4b21-9cc5-317a8d26ea86 req-41e7949f-8275-4a11-90bb-76800781934b service nova] Creating event network-vif-deleted:05f0634c-a530-498b-a8f6-9601bb19f124 for instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 on hv-cinder-84753 Jun 24 10:44:54.426234 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-28a3679b-6aa3-4b21-9cc5-317a8d26ea86 req-41e7949f-8275-4a11-90bb-76800781934b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Jun 24 10:44:54.426940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 440/875] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:55.245318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:55.245932 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:55.253686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:55.254122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:55.254878 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:55.255301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:55.269528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 HTTP/1.1 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:44:55.271199 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:44:55.272862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '03a463b3-7cdc-4aa4-b822-bc800a37d402'} Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:44:55.273987 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:44:55.275456 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:44:55.276779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:44:55.276779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a60581ed-84d9-46e7-8533-de55084271b4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 404 len: 111 microversion: 2.1 time: 0.031305 Jun 24 10:44:55.276779 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 436/876] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:55 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:44:55.282396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b294fee6-384d-4735-887a-e9446dbb6e88 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '.version_select at 0x7f17628ac820>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:55.303744 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b294fee6-384d-4735-887a-e9446dbb6e88 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287499413" status: 202 len: 0 microversion: 2.1 time: 0.025565 Jun 24 10:44:55.304626 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 441/877] 10.222.0.69 () {58 vars in 1217 bytes} [Fri Jun 24 10:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287499413 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:44:55.940069 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-bbfc4067-fc44-483d-a2d4-02d9ef4134a2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: .version_select at 0x7f176203d670>, body: {"keypair": {"name": "tempest-keypair-1450624056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2hurmP4Kg2pCFcwi8F9EgdvzlHx1PXDDSArooKeMgwO0FEW+mfDYfTPPtKnn9hUVj/9KBAlYOCKE257Y0BkGV1ndDGU+9ctjKOxKxv7UfQsEPkI0eBFdux2iTt7WUWAQ=="}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:55.954361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-bbfc4067-fc44-483d-a2d4-02d9ef4134a2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:44:55.958208 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-bbfc4067-fc44-483d-a2d4-02d9ef4134a2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:44:55.983207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-bbfc4067-fc44-483d-a2d4-02d9ef4134a2 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047031 Jun 24 10:44:55.983773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 437/878] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:44:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:44:57.246532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-707349384", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d21023a8-a179-44ed-9a96-27e103b0914f"}], "security_groups": [{"name": "tempest-securitygroup--1904708772"}], "key_name": "tempest-keypair-1450624056", "user_data": "}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:44:57.353650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.network.neutron [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] validate_networks() for [('d21023a8-a179-44ed-9a96-27e103b0914f', None, None, None, None, None)] {{(pid=124303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:44:57.728419 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:44:57.728891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image limits 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:44:57.729358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:44:57.729762 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image pref 0:0:0 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:44:57.730151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.virt.hardware [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:44:57.739918 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:57.740355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:57.741204 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:57.741633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:57.758442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:44:57.762742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:44:57.775984 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Going to run 1 instances... {{(pid=124303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:44:57.778375 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:44:57.829681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-93f11d4d-1f4c-4df6-a3fc-6dd9a14d38aa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588178 Jun 24 10:44:57.830355 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 442/879] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:44:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:44:57.840473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ecfa6688-1310-4640-b1cd-1d86a5ec3fc0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:57.841206 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ecfa6688-1310-4640-b1cd-1d86a5ec3fc0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:57.895306 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ecfa6688-1310-4640-b1cd-1d86a5ec3fc0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:57.905462 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ecfa6688-1310-4640-b1cd-1d86a5ec3fc0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1241 microversion: 2.1 time: 0.068640 Jun 24 10:44:57.906041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 438/880] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:57 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:44:58.924144 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:44:58.925584 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:44:58.932483 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:58.932960 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:58.933848 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:44:58.934290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:44:58.998970 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:44:59.006340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8a6f58ab-89e2-4faf-a62d-e950aca1af26 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1299 microversion: 2.1 time: 0.087318 Jun 24 10:44:59.006904 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 443/881] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:44:58 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:00.023789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:00.025461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:00.032107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:00.032849 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:00.033838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:00.034272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:00.185558 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:00.193484 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2ac0e644-58e2-4f0a-a61e-5e84121b0f81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1367 microversion: 2.1 time: 0.173869 Jun 24 10:45:00.194247 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 439/882] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:00 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:00.270232 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-74f8fbff-5511-463f-b8b1-1c97afffcd40 req-d5335c02-7465-429e-97dc-b2b885e45ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7baca8-b738-4934-bfd8-285d30dbe922", "tag": "88423aa7-a870-4943-b4f1-2519e4cca0f0"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:00.282247 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-74f8fbff-5511-463f-b8b1-1c97afffcd40 req-d5335c02-7465-429e-97dc-b2b885e45ebf service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:00.282643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-74f8fbff-5511-463f-b8b1-1c97afffcd40 req-d5335c02-7465-429e-97dc-b2b885e45ebf service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:00.298989 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-74f8fbff-5511-463f-b8b1-1c97afffcd40 req-d5335c02-7465-429e-97dc-b2b885e45ebf service nova] Creating event network-changed:88423aa7-a870-4943-b4f1-2519e4cca0f0 for instance 4d7baca8-b738-4934-bfd8-285d30dbe922 on hv-cinder-84753 Jun 24 10:45:00.304693 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-74f8fbff-5511-463f-b8b1-1c97afffcd40 req-d5335c02-7465-429e-97dc-b2b885e45ebf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041948 Jun 24 10:45:00.306142 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 444/883] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:01.214111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:01.214883 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:01.223667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:01.224207 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:01.225187 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:01.225714 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:01.370289 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:01.381627 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ae75e30f-af34-4c9b-b3ef-7dddc1f60959 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1367 microversion: 2.1 time: 0.173093 Jun 24 10:45:01.382470 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 440/884] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:01 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:02.405189 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:02.405808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:02.412320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:02.412764 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:02.413541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:02.413965 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:02.549528 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:02.562057 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e4e3553a-f6f7-466a-88bc-ab1508895c28 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1367 microversion: 2.1 time: 0.161480 Jun 24 10:45:02.562891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 445/885] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:02 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:03.583405 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:03.584233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:03.592680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:03.593151 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:03.593917 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:03.594428 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:03.740927 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:03.752804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-093e0c98-1a27-4e44-8f76-93c2eb0dfa6b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1367 microversion: 2.1 time: 0.175729 Jun 24 10:45:03.753528 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 441/886] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:03 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:03.975034 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-8030cdb2-432c-468d-b780-37450af36f4f req-a028c66b-cff0-4aef-bfdc-ebd5d65107df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7baca8-b738-4934-bfd8-285d30dbe922", "name": "network-vif-plugged", "status": "completed", "tag": "88423aa7-a870-4943-b4f1-2519e4cca0f0"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:03.983643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-8030cdb2-432c-468d-b780-37450af36f4f req-a028c66b-cff0-4aef-bfdc-ebd5d65107df service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:03.984072 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-8030cdb2-432c-468d-b780-37450af36f4f req-a028c66b-cff0-4aef-bfdc-ebd5d65107df service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:03.995454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-8030cdb2-432c-468d-b780-37450af36f4f req-a028c66b-cff0-4aef-bfdc-ebd5d65107df service nova] Creating event network-vif-plugged:88423aa7-a870-4943-b4f1-2519e4cca0f0 for instance 4d7baca8-b738-4934-bfd8-285d30dbe922 on hv-cinder-84753 Jun 24 10:45:04.000290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-8030cdb2-432c-468d-b780-37450af36f4f req-a028c66b-cff0-4aef-bfdc-ebd5d65107df service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029474 Jun 24 10:45:04.001233 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 446/887] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:04.776724 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:04.777689 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:04.788789 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:04.789538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:04.791223 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:04.791666 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:04.929550 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:04.937700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-141fdd67-9206-4ec1-bc10-f258b5471da8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1367 microversion: 2.1 time: 0.168484 Jun 24 10:45:04.938240 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 442/888] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:04 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:05.959605 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:05.960662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:05.968046 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:05.968489 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:05.969286 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:05.969713 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:06.108409 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:06.116322 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cdde50ae-3180-4507-acee-d86330c3360b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1557 microversion: 2.1 time: 0.164081 Jun 24 10:45:06.116922 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 447/889] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:05 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:06.132759 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:06.133289 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:06.140433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:06.140910 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:06.141673 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:06.142087 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:06.229459 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e6090c97-702f-4d27-b013-c0fd56096566 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100623 Jun 24 10:45:06.230132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 443/890] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:45:06 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:45:07.195009 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-a75ecebf-baf4-492e-8423-984300278372 req-3b9656fc-c444-4eb3-852c-ba172a35ed86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7baca8-b738-4934-bfd8-285d30dbe922", "tag": "88423aa7-a870-4943-b4f1-2519e4cca0f0"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:07.203893 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-a75ecebf-baf4-492e-8423-984300278372 req-3b9656fc-c444-4eb3-852c-ba172a35ed86 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:07.204335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-a75ecebf-baf4-492e-8423-984300278372 req-3b9656fc-c444-4eb3-852c-ba172a35ed86 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:07.215372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-a75ecebf-baf4-492e-8423-984300278372 req-3b9656fc-c444-4eb3-852c-ba172a35ed86 service nova] Creating event network-changed:88423aa7-a870-4943-b4f1-2519e4cca0f0 for instance 4d7baca8-b738-4934-bfd8-285d30dbe922 on hv-cinder-84753 Jun 24 10:45:07.220466 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-a75ecebf-baf4-492e-8423-984300278372 req-3b9656fc-c444-4eb3-852c-ba172a35ed86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029168 Jun 24 10:45:07.222326 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 448/891] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:12.246612 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:12.251004 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1731931838"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:12.251550 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:12.258492 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:12.258952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:12.259740 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:12.260630 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:12.394008 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.network.security_group_api [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Removing security group d361f4ee-86b5-42f0-b035-45a830422599 from port 8f5ac905-2e34-4d60-a69f-39b37fc56415 Jun 24 10:45:12.744893 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-9450ea13-27c6-4184-b92a-959cb2b0b49b tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action" status: 202 len: 0 microversion: 2.1 time: 0.499650 Jun 24 10:45:12.745720 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 444/892] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:45:12 2022] POST /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:45:12.759606 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-ad91cbfd-7a96-44eb-a1bf-e01c2f53d614 req-d770a41a-27bf-4913-ae81-da743b38ca00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:12.769063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:12.770148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:12.774919 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ad91cbfd-7a96-44eb-a1bf-e01c2f53d614 req-d770a41a-27bf-4913-ae81-da743b38ca00 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:12.775728 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ad91cbfd-7a96-44eb-a1bf-e01c2f53d614 req-d770a41a-27bf-4913-ae81-da743b38ca00 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:12.794791 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-ad91cbfd-7a96-44eb-a1bf-e01c2f53d614 req-d770a41a-27bf-4913-ae81-da743b38ca00 service nova] Creating event network-changed:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:45:12.800901 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-ad91cbfd-7a96-44eb-a1bf-e01c2f53d614 req-d770a41a-27bf-4913-ae81-da743b38ca00 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045302 Jun 24 10:45:12.802508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 449/893] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:14.262445 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:14.263010 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:14.269336 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:14.269771 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:14.270518 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:14.270939 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:14.357046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lazy-loading 'services' on Instance uuid 936ae267-07d2-4640-9876-50bc27cce9ee {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:45:14.434927 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-ebe9e092-1d3b-4450-be72-e14b708e005c tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments/45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1" status: 202 len: 0 microversion: 2.1 time: 0.176731 Jun 24 10:45:14.435716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 445/894] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:45:14 2022] DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments/45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:45:14.445558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:14.446650 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:14.453983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:14.454699 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:14.455470 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:14.455887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:14.490731 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1a1c8beb-a362-4a77-9fe9-d75c697e4e7a tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049726 Jun 24 10:45:14.491535 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 450/895] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:45:14 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:14.816342 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f3084626-e8d5-4529-8846-bd111725e9d8 req-a75fcbde-8835-4200-80d5-04ee582f53b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:14.825126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f3084626-e8d5-4529-8846-bd111725e9d8 req-a75fcbde-8835-4200-80d5-04ee582f53b4 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:14.825557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f3084626-e8d5-4529-8846-bd111725e9d8 req-a75fcbde-8835-4200-80d5-04ee582f53b4 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:14.836525 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f3084626-e8d5-4529-8846-bd111725e9d8 req-a75fcbde-8835-4200-80d5-04ee582f53b4 service nova] Creating event network-changed:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:45:14.841952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f3084626-e8d5-4529-8846-bd111725e9d8 req-a75fcbde-8835-4200-80d5-04ee582f53b4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029689 Jun 24 10:45:14.843349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 446/896] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:15.503541 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:15.504383 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:15.511433 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:15.511878 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:15.512633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:15.513104 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:15.543021 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-99bd371c-b772-4824-a7ae-eb28a5d469d3 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043590 Jun 24 10:45:15.543572 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 451/897] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:45:15 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:45:15.554682 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:15.555278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:15.561985 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:15.562423 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:15.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:15.563588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:15.644104 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] HTTP exception thrown: Instance 936ae267-07d2-4640-9876-50bc27cce9ee is not attached to volume 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Request method failure captured: Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments/45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 HTTP/1.1 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZU4Ok4RmY8KOaKvHdm5Kowc1NyDqPXhbjCHwB_nmVK1cefJ-xyYUEab6wivwM98fo0xVMpw0-dJCxCAUaFwRwmzlEhKHZjefCZcVv6P0n8a8TPgi4s1Yk8c4akaLeg_zWlWpVCa26JILRhWGL0y2hzQnQA-1TJ3hHs49DYUdl0hP_8 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: c2ca2c1ee6294b2fb8020ea0b1d73d72 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:45:15.646559 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2ca2c1ee6294b2fb8020ea0b1d73d72", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: c2ca2c1ee6294b2fb8020ea0b1d73d72 Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-TestMinimumBasicScenario-1857568532-project Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 08dfca461f9947c08f885161891deb10 Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-TestMinimumBasicScenario-1857568532-project Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:45:15.648157 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 936ae267-07d2-4640-9876-50bc27cce9ee is not attached to volume 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'server_id': '936ae267-07d2-4640-9876-50bc27cce9ee', 'id': '45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1'} Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1. Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:45:15.649126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936ae267-07d2-4640-9876-50bc27cce9ee is not attached to volume 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936ae267-07d2-4640-9876-50bc27cce9ee is not attached to volume 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:15.651070 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Returning 404 to user: Instance 936ae267-07d2-4640-9876-50bc27cce9ee is not attached to volume 45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:45:15.652458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7953c456-7b62-46f7-ac3e-7883f45b9017 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments/45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1" status: 404 len: 154 microversion: 2.1 time: 0.098135 Jun 24 10:45:15.652458 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 447/898] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:45:15 2022] DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee/os-volume_attachments/45c0d9e3-4fbb-4f38-a935-f2bb57b68ab1 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:45:16.802165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:16.802680 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:16.809943 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:16.810387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:16.811156 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:16.811591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:16.838510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:45:16.920653 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-76be2cde-c21a-4ff2-9880-f494fffbc88d tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 204 len: 0 microversion: 2.1 time: 0.122036 Jun 24 10:45:16.921334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 452/899] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:45:16 2022] DELETE /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:45:16.929951 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:16.930601 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:16.937808 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:16.938250 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:16.939072 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:16.939508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:17.084309 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:17.093115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-09568c51-4406-4f57-85d4-8d693baa6ed4 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1553 microversion: 2.1 time: 0.167151 Jun 24 10:45:17.093691 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 448/900] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:16 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:18.115820 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:18.116997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:18.127917 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:18.128711 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:18.130014 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:18.130734 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:18.265911 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:18.277245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9a19b402-e5d3-4a2e-ae0c-2f9593871b36 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1553 microversion: 2.1 time: 0.168231 Jun 24 10:45:18.278014 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 453/901] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:18 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:19.291181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-4428683e-f155-457e-8304-9cce1a05d917 req-ed0aea5b-ebbc-4091-a2e8-0b6a0d7f8e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ae267-07d2-4640-9876-50bc27cce9ee", "name": "network-vif-deleted", "tag": "8f5ac905-2e34-4d60-a69f-39b37fc56415"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:19.299851 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:19.300468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:19.301930 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4428683e-f155-457e-8304-9cce1a05d917 req-ed0aea5b-ebbc-4091-a2e8-0b6a0d7f8e54 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:19.302538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4428683e-f155-457e-8304-9cce1a05d917 req-ed0aea5b-ebbc-4091-a2e8-0b6a0d7f8e54 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:19.307160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:19.307646 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:19.308428 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:19.308888 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:19.315391 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-4428683e-f155-457e-8304-9cce1a05d917 req-ed0aea5b-ebbc-4091-a2e8-0b6a0d7f8e54 service nova] Creating event network-vif-deleted:8f5ac905-2e34-4d60-a69f-39b37fc56415 for instance 936ae267-07d2-4640-9876-50bc27cce9ee on hv-cinder-84753 Jun 24 10:45:19.321177 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-4428683e-f155-457e-8304-9cce1a05d917 req-ed0aea5b-ebbc-4091-a2e8-0b6a0d7f8e54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Jun 24 10:45:19.322039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 449/902] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:19.373108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dfca461f9947c08f885161891deb10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ca2c1ee6294b2fb8020ea0b1d73d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:19.381077 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1174b7c3-9a25-422f-820f-4ff0a9273350 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 200 len: 1511 microversion: 2.1 time: 0.084990 Jun 24 10:45:19.381671 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 454/903] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:19 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:20.403850 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:20.405039 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] [instance: 936ae267-07d2-4640-9876-50bc27cce9ee] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:20.415586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:20.416315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:20.417369 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:20.417796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:20.431212 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] HTTP exception thrown: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Request method failure captured: Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee HTTP/1.1 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZU4Ok4RmY8KOaKvHdm5Kowc1NyDqPXhbjCHwB_nmVK1cefJ-xyYUEab6wivwM98fo0xVMpw0-dJCxCAUaFwRwmzlEhKHZjefCZcVv6P0n8a8TPgi4s1Yk8c4akaLeg_zWlWpVCa26JILRhWGL0y2hzQnQA-1TJ3hHs49DYUdl0hP_8 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: c2ca2c1ee6294b2fb8020ea0b1d73d72 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:45:20.432945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c2ca2c1ee6294b2fb8020ea0b1d73d72", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c2ca2c1ee6294b2fb8020ea0b1d73d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: c2ca2c1ee6294b2fb8020ea0b1d73d72 Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1857568532 Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-TestMinimumBasicScenario-1857568532-project Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 08dfca461f9947c08f885161891deb10 Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-TestMinimumBasicScenario-1857568532-project Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. Jun 24 10:45:20.434347 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '936ae267-07d2-4640-9876-50bc27cce9ee'} Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:45:20.435134 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. Jun 24 10:45:20.436616 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:20.438080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Returning 404 to user: Instance 936ae267-07d2-4640-9876-50bc27cce9ee could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:45:20.438080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1de148ad-3354-402d-9672-01007c4b0d13 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee" status: 404 len: 111 microversion: 2.1 time: 0.038118 Jun 24 10:45:20.438080 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 450/904] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:20 2022] GET /compute/v2.1/servers/936ae267-07d2-4640-9876-50bc27cce9ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:45:20.443328 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a4f5d487-f88f-4c88-a640-aac923e29854 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] Calling method '.version_select at 0x7f17627dab80>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:20.465090 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a4f5d487-f88f-4c88-a640-aac923e29854 tempest-TestMinimumBasicScenario-1857568532 tempest-TestMinimumBasicScenario-1857568532-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-496602068" status: 202 len: 0 microversion: 2.1 time: 0.025557 Jun 24 10:45:20.465771 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 455/905] 10.222.0.69 () {58 vars in 1268 bytes} [Fri Jun 24 10:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-496602068 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:45:43.065523 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:43.066241 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:43.068933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:43.069647 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:43.075392 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:43.075887 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:43.076716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:43.077215 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:43.104239 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d5f482f1-862b-43ad-98dc-c02b6ecf799d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/ips" status: 200 len: 150 microversion: 2.1 time: 0.045373 Jun 24 10:45:43.104938 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 451/906] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:45:43 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:44.453979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:44.454739 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:44.459006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "761d169c-8f81-4aec-990a-fdfeffa86057"}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:44.460058 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:44.468977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:44.469385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:44.470150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:44.470574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:44.938308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f6b6ad2d-3ac7-4462-92d2-e45b57514ac1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485530 Jun 24 10:45:44.938921 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 456/907] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:45:44 2022] POST /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:51.424996 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "761d169c-8f81-4aec-990a-fdfeffa86057"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:51.426091 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:51.432292 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.432764 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.433539 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.433975 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.569406 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: POST /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments HTTP/1.1 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 74 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:45:51.570945 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {"volumeAttachment": {"volumeId": "761d169c-8f81-4aec-990a-fdfeffa86057"}} Jun 24 10:45:51.572436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'server_id': '4d7baca8-b738-4934-bfd8-285d30dbe922', 'body': {'volumeAttachment': {'volumeId': '761d169c-8f81-4aec-990a-fdfeffa86057'}}} Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:51.573269 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:51.574508 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 400 to user: Invalid volume: volume 761d169c-8f81-4aec-990a-fdfeffa86057 is already attached to instances: 4d7baca8-b738-4934-bfd8-285d30dbe922 {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2184ff64-d8db-449a-843a-557b86dbc889 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151781 Jun 24 10:45:51.575784 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 452/908] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:45:51 2022] POST /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:45:51.634696 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:51.635229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:51.642377 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.642818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.643575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.644004 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.723940 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lazy-loading 'services' on Instance uuid 4d7baca8-b738-4934-bfd8-285d30dbe922 {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:45:51.802034 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ee0eb8d1-c8b1-4f22-9a8e-acbbb76cc197 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments/761d169c-8f81-4aec-990a-fdfeffa86057" status: 202 len: 0 microversion: 2.1 time: 0.171703 Jun 24 10:45:51.802623 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 457/909] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:45:51 2022] DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments/761d169c-8f81-4aec-990a-fdfeffa86057 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:45:51.812149 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:51.813376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:51.819879 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.820327 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.821126 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:51.821554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:51.856071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7b6f808c-55c6-41ed-89c5-9350892b1756 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048230 Jun 24 10:45:51.856631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 453/910] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:45:51 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:52.874198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:52.875930 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:52.884130 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:52.884573 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:52.885402 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:52.885838 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:52.918423 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-c0baa760-1f24-455f-a7b7-99c19c3452c4 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052365 Jun 24 10:45:52.918975 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 458/911] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:45:52 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:45:52.977800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:52.978322 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:52.985310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:52.985757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:52.986522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:52.986958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:53.014356 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:45:53.097499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a22b328a-eb97-45a3-92cc-4e57e0595777 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 204 len: 0 microversion: 2.1 time: 0.123647 Jun 24 10:45:53.098452 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 454/912] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:45:52 2022] DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:45:53.106891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:53.107508 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:53.113799 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:53.114243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:53.115002 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:53.115437 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:53.253118 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:53.262543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0b855b91-f1df-4dd6-a741-67d9c862c423 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1682 microversion: 2.1 time: 0.159364 Jun 24 10:45:53.263336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 459/913] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:53 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:54.287686 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:54.288541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:54.297025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:54.297576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:54.298509 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:54.299037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:54.441617 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:54.449796 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cd786ce2-056d-4d38-bc84-35a450311dce tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1682 microversion: 2.1 time: 0.169302 Jun 24 10:45:54.450372 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 455/914] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:54 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:55.412320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-35ca0b65-ba48-4388-82b3-a2a35710792b req-f43c4d9a-fa12-4752-b900-12042b48e379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7baca8-b738-4934-bfd8-285d30dbe922", "name": "network-vif-deleted", "tag": "88423aa7-a870-4943-b4f1-2519e4cca0f0"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:55.423408 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-35ca0b65-ba48-4388-82b3-a2a35710792b req-f43c4d9a-fa12-4752-b900-12042b48e379 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:55.424010 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-35ca0b65-ba48-4388-82b3-a2a35710792b req-f43c4d9a-fa12-4752-b900-12042b48e379 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:55.436812 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-35ca0b65-ba48-4388-82b3-a2a35710792b req-f43c4d9a-fa12-4752-b900-12042b48e379 service nova] Creating event network-vif-deleted:88423aa7-a870-4943-b4f1-2519e4cca0f0 for instance 4d7baca8-b738-4934-bfd8-285d30dbe922 on hv-cinder-84753 Jun 24 10:45:55.442586 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-35ca0b65-ba48-4388-82b3-a2a35710792b req-f43c4d9a-fa12-4752-b900-12042b48e379 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033910 Jun 24 10:45:55.447728 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 460/915] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:55.477112 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:55.480187 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:55.488262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:55.489127 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:55.490210 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:55.490948 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:55.565035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:55.574433 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-7a6bb0f4-f77e-489a-b5d1-6b6122268973 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 200 len: 1326 microversion: 2.1 time: 0.111050 Jun 24 10:45:55.575034 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 456/916] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:55 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:45:56.592181 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:56.592910 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:56.600716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:56.601282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:56.602064 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:56.602498 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:56.616083 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 HTTP/1.1 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:45:56.617772 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:45:56.619282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '4d7baca8-b738-4934-bfd8-285d30dbe922'} Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:45:56.623478 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:45:56.624729 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:45:56.626047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:45:56.626047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-06e99201-9708-4c6f-9b7c-863a89ec88f8 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jun 24 10:45:56.626047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 461/917] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:56 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:45:56.628061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e6cce20e-53d6-4af9-8ee9-aa834ea74780 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '.version_select at 0x7f17620733a0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:56.650384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e6cce20e-53d6-4af9-8ee9-aa834ea74780 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450624056" status: 202 len: 0 microversion: 2.1 time: 0.026133 Jun 24 10:45:56.651099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 457/918] 10.222.0.69 () {58 vars in 1220 bytes} [Fri Jun 24 10:45:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450624056 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:45:57.284514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d8ec2088-40ae-4f42-87e7-ddd142835bbd tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: .version_select at 0x7f17627b9e50>, body: {"keypair": {"name": "tempest-keypair-805859204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh8kdIjLfegeG7IfsVJ2MvrEnRvMC/DmnMjxWUZymtQXCaZKomskKtghVuEYt9GMbldsdJMXcwFRaD6TZ32P5EdBGfzump6DJ9KqAqEwntqV1NyNb5tur+Eg8+hn0qTeQ=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:57.298967 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-d8ec2088-40ae-4f42-87e7-ddd142835bbd tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:45:57.303182 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-d8ec2088-40ae-4f42-87e7-ddd142835bbd tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:45:57.331060 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d8ec2088-40ae-4f42-87e7-ddd142835bbd tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050262 Jun 24 10:45:57.331966 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 462/919] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:45:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:45:58.654041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1338202613", "imageRef": "6b71c9d1-1905-4dd9-896a-d30d926cf588", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d21023a8-a179-44ed-9a96-27e103b0914f"}], "security_groups": [{"name": "tempest-securitygroup--1072224592"}], "key_name": "tempest-keypair-805859204", "user_data": "}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:45:58.765040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] validate_networks() for [('d21023a8-a179-44ed-9a96-27e103b0914f', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:45:59.422457 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:45:59.422872 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:45:59.423338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:45:59.423735 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:45:59.424132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:45:59.433374 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:59.433812 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:59.434591 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:45:59.435017 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:45:59.452557 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:45:59.457037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Getting quotas for user c38435f90f9a4cceba68faec58e9a5e4 and project e946a4548f114b088ac5073b28e31ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:45:59.469577 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:45:59.471838 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b71c9d1-1905-4dd9-896a-d30d926cf588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:45:59.521787 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e4580e49-cedf-4456-9aab-c8fef648a80c tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.872164 Jun 24 10:45:59.522583 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 458/920] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:45:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:45:59.532924 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0d222ea8-3ba8-4cdb-a682-38ad1d2b5cc5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:45:59.533649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0d222ea8-3ba8-4cdb-a682-38ad1d2b5cc5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:45:59.592054 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-0d222ea8-3ba8-4cdb-a682-38ad1d2b5cc5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:45:59.599306 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0d222ea8-3ba8-4cdb-a682-38ad1d2b5cc5 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1241 microversion: 2.1 time: 0.070750 Jun 24 10:45:59.599918 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 463/921] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:45:59 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:00.616196 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:00.617106 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:00.624148 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:00.624595 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:00.625554 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:00.625984 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:00.688566 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:00.696148 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-a6a192e5-db13-419b-a1b1-ed7a337efafa tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1299 microversion: 2.1 time: 0.084602 Jun 24 10:46:00.696722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 459/922] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:00 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:01.713400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:01.713927 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:01.720798 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:01.721500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:01.722495 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:01.722933 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:01.810130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-4886a803-481e-4940-a6a2-7624d12012ff req-4ff7fe48-167f-445b-8b01-803a42de35ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1187770e-3e81-4957-9a25-3c99c4e11e8c", "tag": "f0de1a67-a465-470b-a6c1-22977db06e5d"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:01.825006 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4886a803-481e-4940-a6a2-7624d12012ff req-4ff7fe48-167f-445b-8b01-803a42de35ea service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:01.825726 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-4886a803-481e-4940-a6a2-7624d12012ff req-4ff7fe48-167f-445b-8b01-803a42de35ea service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:01.843606 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-4886a803-481e-4940-a6a2-7624d12012ff req-4ff7fe48-167f-445b-8b01-803a42de35ea service nova] Creating event network-changed:f0de1a67-a465-470b-a6c1-22977db06e5d for instance 1187770e-3e81-4957-9a25-3c99c4e11e8c on hv-cinder-84753 Jun 24 10:46:01.850968 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-4886a803-481e-4940-a6a2-7624d12012ff req-4ff7fe48-167f-445b-8b01-803a42de35ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044796 Jun 24 10:46:01.852420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 460/923] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:01.881150 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:01.889566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-5302139a-fa49-46e1-90dc-6e4bebbde0ca tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1367 microversion: 2.1 time: 0.180309 Jun 24 10:46:01.890147 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 464/924] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:01 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:02.908060 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:02.908858 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:02.915700 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:02.916159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:02.916943 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:02.917368 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:03.050865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:03.058954 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e5bfb13b-af59-4d56-b74b-dd656252fb40 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1367 microversion: 2.1 time: 0.155423 Jun 24 10:46:03.059527 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 461/925] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:02 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:04.076951 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:04.077721 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:04.084639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:04.085166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:04.086411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:04.087018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:04.223833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:04.231588 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-382fce01-5514-4ebf-9461-e716e5b29e4a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1367 microversion: 2.1 time: 0.158637 Jun 24 10:46:04.232135 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 465/926] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:04 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:05.253301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:05.254519 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:05.262832 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:05.263277 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:05.264037 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:05.264473 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:05.423132 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:05.431167 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d4dc78a5-a424-41a9-85b0-88568f3bea89 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1367 microversion: 2.1 time: 0.185189 Jun 24 10:46:05.431705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 462/927] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:05 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:06.248221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-0aff89de-fea6-46cc-b277-d52dcb11b63c req-c247b4ad-4faf-4f50-a846-3fdaa9b4a64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1187770e-3e81-4957-9a25-3c99c4e11e8c", "name": "network-vif-plugged", "status": "completed", "tag": "f0de1a67-a465-470b-a6c1-22977db06e5d"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:06.257219 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-0aff89de-fea6-46cc-b277-d52dcb11b63c req-c247b4ad-4faf-4f50-a846-3fdaa9b4a64d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:06.257670 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-0aff89de-fea6-46cc-b277-d52dcb11b63c req-c247b4ad-4faf-4f50-a846-3fdaa9b4a64d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:06.269336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-0aff89de-fea6-46cc-b277-d52dcb11b63c req-c247b4ad-4faf-4f50-a846-3fdaa9b4a64d service nova] Creating event network-vif-plugged:f0de1a67-a465-470b-a6c1-22977db06e5d for instance 1187770e-3e81-4957-9a25-3c99c4e11e8c on hv-cinder-84753 Jun 24 10:46:06.274296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-0aff89de-fea6-46cc-b277-d52dcb11b63c req-c247b4ad-4faf-4f50-a846-3fdaa9b4a64d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Jun 24 10:46:06.274911 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 466/928] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:06.451338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:06.451905 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:06.459629 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:06.460054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:06.461217 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:06.461368 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:06.592395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:06.600587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-845a6d5d-4e1c-47c0-859c-72e0a87ea3a9 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1367 microversion: 2.1 time: 0.154049 Jun 24 10:46:06.601210 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 463/929] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:06 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:07.619994 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:07.621656 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:07.628400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:07.628882 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:07.629660 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:07.630090 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:07.763015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:07.771218 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-53966d36-cc1b-4957-9eeb-503cb151a8e0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1556 microversion: 2.1 time: 0.156492 Jun 24 10:46:07.771808 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 467/930] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:07 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:07.787475 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:07.787986 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:07.794955 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:07.795398 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:07.796154 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:07.796587 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:07.883830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1aaf2471-2b55-42a0-8796-9ac3adb5841d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100238 Jun 24 10:46:07.884429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 464/931] 10.222.0.69 () {58 vars in 1274 bytes} [Fri Jun 24 10:46:07 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:08.174923 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:08.181415 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-c34b5fbf-22b5-435a-b259-b612d35c2203 req-78fcd98c-8048-4d99-ac02-6930894d8d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a3bcc3-9c26-4e57-b324-3e2028efa880", "tag": "10d4b61f-852d-4fcc-98ad-381d69879ca4"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:08.182343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:08.195141 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.195988 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.197358 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c34b5fbf-22b5-435a-b259-b612d35c2203 req-78fcd98c-8048-4d99-ac02-6930894d8d7e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.198357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.198865 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c34b5fbf-22b5-435a-b259-b612d35c2203 req-78fcd98c-8048-4d99-ac02-6930894d8d7e service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.199340 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.216052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-c34b5fbf-22b5-435a-b259-b612d35c2203 req-78fcd98c-8048-4d99-ac02-6930894d8d7e service nova] Creating event network-changed:10d4b61f-852d-4fcc-98ad-381d69879ca4 for instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 on hv-cinder-84753 Jun 24 10:46:08.221138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-c34b5fbf-22b5-435a-b259-b612d35c2203 req-78fcd98c-8048-4d99-ac02-6930894d8d7e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043471 Jun 24 10:46:08.222478 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 465/932] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:08.239165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Going to try to terminate instance {{(pid=124303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:46:08.357451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9239e1ae-fc6b-40fc-84d8-f29afedca70e tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 204 len: 0 microversion: 2.1 time: 0.185934 Jun 24 10:46:08.361088 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 468/933] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:46:08 2022] DELETE /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:46:08.369745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:08.370436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:08.384024 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.384716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.385636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.386108 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.623704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:08.632081 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c9f138f5-955f-4400-b92b-9f1ace7ef545 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1578 microversion: 2.1 time: 0.266552 Jun 24 10:46:08.632830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 466/934] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:08 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1578 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:08.928615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-73e32b47-1811-418e-b5f6-de06baf0f849 req-2b715c8c-7235-4dbb-990a-054597d9d217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1187770e-3e81-4957-9a25-3c99c4e11e8c", "tag": "f0de1a67-a465-470b-a6c1-22977db06e5d"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:08.939249 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-73e32b47-1811-418e-b5f6-de06baf0f849 req-2b715c8c-7235-4dbb-990a-054597d9d217 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:08.939707 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-73e32b47-1811-418e-b5f6-de06baf0f849 req-2b715c8c-7235-4dbb-990a-054597d9d217 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:08.953411 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-73e32b47-1811-418e-b5f6-de06baf0f849 req-2b715c8c-7235-4dbb-990a-054597d9d217 service nova] Creating event network-changed:f0de1a67-a465-470b-a6c1-22977db06e5d for instance 1187770e-3e81-4957-9a25-3c99c4e11e8c on hv-cinder-84753 Jun 24 10:46:08.959153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-73e32b47-1811-418e-b5f6-de06baf0f849 req-2b715c8c-7235-4dbb-990a-054597d9d217 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034520 Jun 24 10:46:08.961000 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 469/935] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:09.650962 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:09.651588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:09.654077 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:09.654757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:09.660824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:09.661511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:09.662282 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:09.662697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:09.893243 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:09.904793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-69667e47-0926-45bf-b670-ef48f7c4f78a tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1578 microversion: 2.1 time: 0.257985 Jun 24 10:46:09.905348 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 467/936] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:09 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:46:10.317056 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=6 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:10.322794 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-16e444e2-94a6-4b98-bf1c-5bd73347d643 req-0ff8f845-5026-4f7d-9aba-576dcd3376fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a3bcc3-9c26-4e57-b324-3e2028efa880", "name": "network-vif-deleted", "tag": "10d4b61f-852d-4fcc-98ad-381d69879ca4"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:10.332064 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-16e444e2-94a6-4b98-bf1c-5bd73347d643 req-0ff8f845-5026-4f7d-9aba-576dcd3376fd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:10.332501 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-16e444e2-94a6-4b98-bf1c-5bd73347d643 req-0ff8f845-5026-4f7d-9aba-576dcd3376fd service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:10.343983 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-16e444e2-94a6-4b98-bf1c-5bd73347d643 req-0ff8f845-5026-4f7d-9aba-576dcd3376fd service nova] Creating event network-vif-deleted:10d4b61f-852d-4fcc-98ad-381d69879ca4 for instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 on hv-cinder-84753 Jun 24 10:46:10.355047 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-16e444e2-94a6-4b98-bf1c-5bd73347d643 req-0ff8f845-5026-4f7d-9aba-576dcd3376fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038805 Jun 24 10:46:10.355677 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 470/937] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:10.922826 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:10.923438 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:10.930633 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:10.931086 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:10.931855 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:10.932284 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:10.964783 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:10.965173 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:10.965649 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lazy-loading 'fault' on Instance uuid a1a3bcc3-9c26-4e57-b324-3e2028efa880 {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:46:11.009041 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:11.016052 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f837415d-fe77-4b94-b740-6534ee348296 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 200 len: 1184 microversion: 2.1 time: 0.097410 Jun 24 10:46:11.016631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 468/938] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:10 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 1184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:12.036828 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:12.037743 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: a1a3bcc3-9c26-4e57-b324-3e2028efa880] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:12.045063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:12.045504 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:12.046269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:12.046701 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:12.060265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] HTTP exception thrown: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Request method failure captured: Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 HTTP/1.1 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZQ0_oiuhyUsufdNkmGXHWA6jANXPIxN0gqzcG_CDZOn51lPsMoVoOTnuAQY_v9PhjGC6zSSFbHDcCJgLwXmw2QVL-pM9WuhUbBPTJIejElW6qYN3ENC4cDUCvNuOMHqrWG0mC81aozbglpP61qGfVEHgfiH3o1hVPasmY5pj_S1LDw Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:46:12.061977 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8eb1e5f40033474c947399c22bb0a2d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 5fc073d480884782b4084952345382b9 Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. Jun 24 10:46:12.063710 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'a1a3bcc3-9c26-4e57-b324-3e2028efa880'} Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:12.064620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. Jun 24 10:46:12.066148 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:12.067468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Returning 404 to user: Instance a1a3bcc3-9c26-4e57-b324-3e2028efa880 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:12.067468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2750433a-b3d4-4b1a-a39e-b3a149e4d628 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880" status: 404 len: 111 microversion: 2.1 time: 0.032552 Jun 24 10:46:12.067468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 471/939] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:12 2022] GET /compute/v2.1/servers/a1a3bcc3-9c26-4e57-b324-3e2028efa880 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:15.163313 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:15.163885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:15.164852 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-2f48f29b-48ff-4dcf-8400-b6475a099751 req-f963ef3f-3169-4298-8018-1a266e192dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343e6a2c-4912-4c03-8c30-7221f2ed02ef", "tag": "dc5718e5-e015-401c-99c6-e54a9611e82f"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:15.166397 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:15.169320 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:15.173265 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:15.173803 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:15.174656 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:15.175115 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:15.175240 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-2f48f29b-48ff-4dcf-8400-b6475a099751 req-f963ef3f-3169-4298-8018-1a266e192dfb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:15.175643 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-2f48f29b-48ff-4dcf-8400-b6475a099751 req-f963ef3f-3169-4298-8018-1a266e192dfb service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:15.178326 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:15.180154 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:15.189160 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-2f48f29b-48ff-4dcf-8400-b6475a099751 req-f963ef3f-3169-4298-8018-1a266e192dfb service nova] Creating event network-changed:dc5718e5-e015-401c-99c6-e54a9611e82f for instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef on hv-cinder-84753 Jun 24 10:46:15.195457 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-2f48f29b-48ff-4dcf-8400-b6475a099751 req-f963ef3f-3169-4298-8018-1a266e192dfb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034285 Jun 24 10:46:15.196719 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 472/940] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:15.206337 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:46:15.307704 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b63bcb4d-0f58-4cf2-8ddf-60b63439404f tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "DELETE /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 204 len: 0 microversion: 2.1 time: 0.148636 Jun 24 10:46:15.312479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 469/941] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:46:15 2022] DELETE /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:46:15.318194 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:15.318891 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:15.327494 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:15.327938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:15.328714 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:15.329164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:15.469786 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:15.477978 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-bd8495c3-fb22-4dee-9737-4d795d830218 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1576 microversion: 2.1 time: 0.164122 Jun 24 10:46:15.478639 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 473/942] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:15 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:46:16.496631 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:16.497363 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:16.504443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:16.504912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:16.505680 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:16.506107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:16.642736 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:16.655369 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5a91f972-7b3b-4899-b782-d795ef0089ce tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1576 microversion: 2.1 time: 0.162883 Jun 24 10:46:16.656214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 470/943] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:16 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:17.238511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-800fde0c-bfe5-4da8-bdd9-5f2df7f7236b req-8d395ae7-dc58-4e18-99dd-18b16522d7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343e6a2c-4912-4c03-8c30-7221f2ed02ef", "name": "network-vif-deleted", "tag": "dc5718e5-e015-401c-99c6-e54a9611e82f"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:17.247613 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-800fde0c-bfe5-4da8-bdd9-5f2df7f7236b req-8d395ae7-dc58-4e18-99dd-18b16522d7d3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:17.248036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-800fde0c-bfe5-4da8-bdd9-5f2df7f7236b req-8d395ae7-dc58-4e18-99dd-18b16522d7d3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:17.260064 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-800fde0c-bfe5-4da8-bdd9-5f2df7f7236b req-8d395ae7-dc58-4e18-99dd-18b16522d7d3 service nova] Creating event network-vif-deleted:dc5718e5-e015-401c-99c6-e54a9611e82f for instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef on hv-cinder-84753 Jun 24 10:46:17.265205 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-800fde0c-bfe5-4da8-bdd9-5f2df7f7236b req-8d395ae7-dc58-4e18-99dd-18b16522d7d3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030348 Jun 24 10:46:17.265863 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 474/944] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:17.676285 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:17.676971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:17.684678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:17.685158 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:17.685920 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:17.686352 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:17.719436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:17.719812 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:17.720253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lazy-loading 'fault' on Instance uuid 343e6a2c-4912-4c03-8c30-7221f2ed02ef {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:46:17.763795 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc073d480884782b4084952345382b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb1e5f40033474c947399c22bb0a2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:17.771806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6f561c4e-7f6b-4ea1-9340-c93bcbdf8f52 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 200 len: 1229 microversion: 2.1 time: 0.099530 Jun 24 10:46:17.772389 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 471/945] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:17 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:18.793931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:18.794716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: 343e6a2c-4912-4c03-8c30-7221f2ed02ef] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:18.802245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:18.802746 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:18.803607 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:18.804092 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:18.819617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] HTTP exception thrown: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Request method failure captured: Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef HTTP/1.1 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZQ0_oiuhyUsufdNkmGXHWA6jANXPIxN0gqzcG_CDZOn51lPsMoVoOTnuAQY_v9PhjGC6zSSFbHDcCJgLwXmw2QVL-pM9WuhUbBPTJIejElW6qYN3ENC4cDUCvNuOMHqrWG0mC81aozbglpP61qGfVEHgfiH3o1hVPasmY5pj_S1LDw Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:46:18.821995 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8eb1e5f40033474c947399c22bb0a2d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 5fc073d480884782b4084952345382b9 Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. Jun 24 10:46:18.823490 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '343e6a2c-4912-4c03-8c30-7221f2ed02ef'} Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:18.824337 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. Jun 24 10:46:18.825597 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:18.826683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Returning 404 to user: Instance 343e6a2c-4912-4c03-8c30-7221f2ed02ef could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:18.826683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3832674c-01bb-4150-8354-4226597685b2 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef" status: 404 len: 111 microversion: 2.1 time: 0.036350 Jun 24 10:46:18.826683 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 475/946] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:18 2022] GET /compute/v2.1/servers/343e6a2c-4912-4c03-8c30-7221f2ed02ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:19.559716 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:19.560316 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:19.567453 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:19.567891 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:19.568639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:19.569100 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:19.583116 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] HTTP exception thrown: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Request method failure captured: Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 HTTP/1.1 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZQ0_oiuhyUsufdNkmGXHWA6jANXPIxN0gqzcG_CDZOn51lPsMoVoOTnuAQY_v9PhjGC6zSSFbHDcCJgLwXmw2QVL-pM9WuhUbBPTJIejElW6qYN3ENC4cDUCvNuOMHqrWG0mC81aozbglpP61qGfVEHgfiH3o1hVPasmY5pj_S1LDw Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:46:19.584767 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8eb1e5f40033474c947399c22bb0a2d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 5fc073d480884782b4084952345382b9 Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.586256 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'ef73619d-95e3-4358-a61b-7cbe58f76050'} Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:19.586999 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.588233 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.589529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Returning 404 to user: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:19.589529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f8753f16-60cf-4caa-8611-abc5fe3034ea tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 404 len: 111 microversion: 2.1 time: 0.030614 Jun 24 10:46:19.589529 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 472/947] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:46:19 2022] DELETE /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:19.595198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:19.595814 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] [instance: ef73619d-95e3-4358-a61b-7cbe58f76050] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:19.602804 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:19.603253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:19.604018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:19.604451 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:19.618100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] HTTP exception thrown: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Request method failure captured: Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 HTTP/1.1 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZQ0_oiuhyUsufdNkmGXHWA6jANXPIxN0gqzcG_CDZOn51lPsMoVoOTnuAQY_v9PhjGC6zSSFbHDcCJgLwXmw2QVL-pM9WuhUbBPTJIejElW6qYN3ENC4cDUCvNuOMHqrWG0mC81aozbglpP61qGfVEHgfiH3o1hVPasmY5pj_S1LDw Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:46:19.619637 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8eb1e5f40033474c947399c22bb0a2d2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8eb1e5f40033474c947399c22bb0a2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 8eb1e5f40033474c947399c22bb0a2d2 Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-TestVolumeBootPattern-432545666 Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 5fc073d480884782b4084952345382b9 Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-TestVolumeBootPattern-432545666-project Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.621263 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'ef73619d-95e3-4358-a61b-7cbe58f76050'} Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:19.622165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. Jun 24 10:46:19.623609 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:19.625027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Returning 404 to user: Instance ef73619d-95e3-4358-a61b-7cbe58f76050 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:19.625027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-2cdcbb75-728a-4ffa-8971-b2fc5da07fe3 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050" status: 404 len: 111 microversion: 2.1 time: 0.029758 Jun 24 10:46:19.625027 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 476/948] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:19 2022] GET /compute/v2.1/servers/ef73619d-95e3-4358-a61b-7cbe58f76050 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:20.927476 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d228bd1a-ff41-4b69-b76d-2b84c44b9879 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] Calling method '.version_select at 0x7f176231b0d0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:20.948506 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d228bd1a-ff41-4b69-b76d-2b84c44b9879 tempest-TestVolumeBootPattern-432545666 tempest-TestVolumeBootPattern-432545666-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198254431" status: 202 len: 0 microversion: 2.1 time: 0.024864 Jun 24 10:46:20.949542 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 473/949] 10.222.0.69 () {58 vars in 1259 bytes} [Fri Jun 24 10:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198254431 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:46:44.154832 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:44.155558 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:44.158075 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=9 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:44.158824 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=13 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:44.165288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:44.165810 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:44.166686 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:44.167194 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:44.191713 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-59ee6acb-1829-4154-aa35-bbc3c188da0a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/ips" status: 200 len: 148 microversion: 2.1 time: 0.041521 Jun 24 10:46:44.192273 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 477/950] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:46:44 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:45.545575 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:45.546499 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:46:45.550933 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295f83d6-65fc-43a8-98a1-6a794eb92380"}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:45.552054 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:45.560204 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:45.560710 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:45.561551 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:45.562122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:45.823035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e5c5a8b8-5443-41c5-a2d0-9186d61e63a0 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "POST /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278641 Jun 24 10:46:45.823639 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 474/951] 10.222.0.69 () {60 vars in 1322 bytes} [Fri Jun 24 10:46:45 2022] POST /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:52.429066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:52.429615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:52.436376 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:52.436870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:52.437618 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:52.438053 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:52.522454 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lazy-loading 'services' on Instance uuid 1187770e-3e81-4957-9a25-3c99c4e11e8c {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:46:52.610796 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-480a3730-dced-4b6d-ab9c-5e47c4e78bed tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments/295f83d6-65fc-43a8-98a1-6a794eb92380" status: 202 len: 0 microversion: 2.1 time: 0.186356 Jun 24 10:46:52.611384 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 478/952] 10.222.0.69 () {58 vars in 1415 bytes} [Fri Jun 24 10:46:52 2022] DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments/295f83d6-65fc-43a8-98a1-6a794eb92380 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:46:52.620863 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:52.621902 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:52.628418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:52.628916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:52.629857 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:52.630291 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:52.659615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-5e945eff-4efb-49bf-a826-7e25e29ac74a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jun 24 10:46:52.660235 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 475/953] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:46:52 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:53.676879 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:53.677939 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:53.684854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.685296 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:53.686051 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.686476 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:53.715582 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-cbfd49bf-3bc1-4d8d-90c8-269fe7b12119 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046104 Jun 24 10:46:53.716048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 479/954] 10.222.0.69 () {58 vars in 1301 bytes} [Fri Jun 24 10:46:53 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:46:53.781049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:53.781635 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:53.790998 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.791588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:53.792723 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.793304 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:53.820432 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:46:53.904510 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-da90894b-92f6-40d3-9a1b-bc8910c2a50a tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 204 len: 0 microversion: 2.1 time: 0.129626 Jun 24 10:46:53.905123 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 476/955] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:46:53 2022] DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:46:53.913547 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:53.914153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:53.920191 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.920619 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:53.921402 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:53.921825 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:54.077381 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:54.090018 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1d2f5904-ada3-404a-92ae-9d92a6d75a94 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1680 microversion: 2.1 time: 0.180082 Jun 24 10:46:54.090833 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 480/956] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:53 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:55.113229 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:55.114380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:55.125393 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:55.126131 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:55.127376 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:55.128090 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:55.266522 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:55.274440 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8ff924b4-30c1-45f2-94e3-f48206ef98b1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1680 microversion: 2.1 time: 0.168412 Jun 24 10:46:55.275025 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 477/957] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:55 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:56.225687 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-21f5edc9-9e63-4e43-a91f-acec3686d26d req-380f2d4c-3d5f-4d7b-ae22-bbe422ce4e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1187770e-3e81-4957-9a25-3c99c4e11e8c", "name": "network-vif-deleted", "tag": "f0de1a67-a465-470b-a6c1-22977db06e5d"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:46:56.234673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-21f5edc9-9e63-4e43-a91f-acec3686d26d req-380f2d4c-3d5f-4d7b-ae22-bbe422ce4e77 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:56.235229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-21f5edc9-9e63-4e43-a91f-acec3686d26d req-380f2d4c-3d5f-4d7b-ae22-bbe422ce4e77 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:56.249651 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-21f5edc9-9e63-4e43-a91f-acec3686d26d req-380f2d4c-3d5f-4d7b-ae22-bbe422ce4e77 service nova] Creating event network-vif-deleted:f0de1a67-a465-470b-a6c1-22977db06e5d for instance 1187770e-3e81-4957-9a25-3c99c4e11e8c on hv-cinder-84753 Jun 24 10:46:56.255387 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-21f5edc9-9e63-4e43-a91f-acec3686d26d req-380f2d4c-3d5f-4d7b-ae22-bbe422ce4e77 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 Jun 24 10:46:56.256185 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 481/958] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:46:56.291739 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:56.292349 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:56.303874 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:56.304576 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:56.305545 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:56.306159 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:56.390197 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38435f90f9a4cceba68faec58e9a5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946a4548f114b088ac5073b28e31ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:46:56.400219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-b6d4573c-4a61-46f3-a1a0-ae54924e789f tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 200 len: 1326 microversion: 2.1 time: 0.112306 Jun 24 10:46:56.400864 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 478/959] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:56 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:46:57.421545 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:57.422332 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:57.430479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:57.430954 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:57.431706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:57.432132 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:57.445549 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c HTTP/1.1 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:46:57.447198 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:57.448900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '1187770e-3e81-4957-9a25-3c99c4e11e8c'} Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:57.450020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:57.451681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:57.453227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:57.453227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0bb4e041-0821-4e0c-bf1d-6642055810c1 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 404 len: 111 microversion: 2.1 time: 0.033996 Jun 24 10:46:57.453227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 482/960] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:57 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:57.457745 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-171c1107-1e3a-4996-a318-dbbfb3d0122b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '.version_select at 0x7f176213d0d0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:57.477737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-171c1107-1e3a-4996-a318-dbbfb3d0122b tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805859204" status: 202 len: 0 microversion: 2.1 time: 0.023892 Jun 24 10:46:57.478305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 479/961] 10.222.0.69 () {58 vars in 1217 bytes} [Fri Jun 24 10:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805859204 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:46:59.258425 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:59.258961 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:59.265732 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:59.266178 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:59.266937 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:59.267363 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:59.282207 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c HTTP/1.1 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:46:59.283748 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.285385 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '1187770e-3e81-4957-9a25-3c99c4e11e8c'} Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:59.286246 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.288395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.289916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:59.289916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e741312b-837f-483f-92c0-7628b7a64216 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 404 len: 111 microversion: 2.1 time: 0.030658 Jun 24 10:46:59.289916 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 483/962] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:46:59 2022] DELETE /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:46:59.293817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:46:59.294434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 1187770e-3e81-4957-9a25-3c99c4e11e8c] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:46:59.302000 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:59.302494 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:59.303281 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:46:59.303715 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:46:59.317141 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c HTTP/1.1 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:46:59.318773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.320361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '1187770e-3e81-4957-9a25-3c99c4e11e8c'} Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:46:59.321340 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. Jun 24 10:46:59.322793 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:46:59.324272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 1187770e-3e81-4957-9a25-3c99c4e11e8c could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:46:59.324272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c1762a50-681a-437b-9ddc-c755e695eac6 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c" status: 404 len: 111 microversion: 2.1 time: 0.030285 Jun 24 10:46:59.324272 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 480/963] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:46:59 2022] GET /compute/v2.1/servers/1187770e-3e81-4957-9a25-3c99c4e11e8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:00.468243 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:00.468721 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:00.476336 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.476767 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.477567 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.477998 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.491305 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 HTTP/1.1 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:00.492898 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.494424 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '4d7baca8-b738-4934-bfd8-285d30dbe922'} Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:00.495534 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.497101 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.498722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:00.498722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-28b84ff6-2b88-412e-87c3-4fee9102da81 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 404 len: 111 microversion: 2.1 time: 0.030067 Jun 24 10:47:00.498722 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 484/964] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:47:00 2022] DELETE /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:00.502895 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:00.503511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 4d7baca8-b738-4934-bfd8-285d30dbe922] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:00.510315 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.510763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.511518 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.511952 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.526094 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 HTTP/1.1 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:00.527590 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.529262 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '4d7baca8-b738-4934-bfd8-285d30dbe922'} Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:00.530324 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. Jun 24 10:47:00.531876 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.533467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 4d7baca8-b738-4934-bfd8-285d30dbe922 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:00.533467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-25fa9608-1276-4902-8a21-4118ac78e77d tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922" status: 404 len: 111 microversion: 2.1 time: 0.030286 Jun 24 10:47:00.533467 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 481/965] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:00 2022] GET /compute/v2.1/servers/4d7baca8-b738-4934-bfd8-285d30dbe922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:47:00.538134 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:00.538625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:00.544793 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.545318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.546100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.546530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.561564 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 HTTP/1.1 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:00.563164 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.564649 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'b9d092f4-611c-4983-96aa-dd1bf771f4c1'} Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:00.565427 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.566673 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.567979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:00.567979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-11d89929-0c53-4497-9aa8-37b302d67b98 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 404 len: 111 microversion: 2.1 time: 0.030405 Jun 24 10:47:00.567979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 485/966] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:47:00 2022] DELETE /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:00.574536 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:00.575149 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: b9d092f4-611c-4983-96aa-dd1bf771f4c1] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:00.581434 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.581903 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.582654 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:00.583079 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:00.596608 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 HTTP/1.1 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:00.598451 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.600029 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'b9d092f4-611c-4983-96aa-dd1bf771f4c1'} Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:00.600804 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. Jun 24 10:47:00.602071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:00.603156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance b9d092f4-611c-4983-96aa-dd1bf771f4c1 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:00.603156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cdc4bbcf-08f8-48d7-a68e-107d3fea92fe tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1" status: 404 len: 111 microversion: 2.1 time: 0.029333 Jun 24 10:47:00.603156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 482/967] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:00 2022] GET /compute/v2.1/servers/b9d092f4-611c-4983-96aa-dd1bf771f4c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:01.760809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:01.761333 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:01.768186 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:01.768631 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:01.769432 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:01.769870 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:01.784255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 HTTP/1.1 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:01.785956 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.787514 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': '03a463b3-7cdc-4aa4-b822-bc800a37d402'} Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:01.788630 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.790082 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.791896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:01.791896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-9d143041-fd6f-49bb-82a8-8dc0be46cf19 tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 404 len: 111 microversion: 2.1 time: 0.030388 Jun 24 10:47:01.791896 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 486/968] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:47:01 2022] DELETE /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:01.795862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:01.796468 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] [instance: 03a463b3-7cdc-4aa4-b822-bc800a37d402] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:01.803138 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:01.803676 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:01.804425 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:01.804889 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:01.818156 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] HTTP exception thrown: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Request method failure captured: Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 HTTP/1.1 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZUtLUt0j5lvF8i9ukFSbU1UqLuon-jcTxQYWYHPuKvRfyohqehfmBBuNklBRWgpgjkmR4uP_XITFNXnZZBx1nx2LkcJJCsOY2v7TdCjZH8uPMe_FBmkPTmjdluMzeevZ4Vi9y05dsGI3wdY7Wx8JBuMuhFtNL6fH9VNWUT2g0V0BJc Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:01.819737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e946a4548f114b088ac5073b28e31ba0", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e946a4548f114b088ac5073b28e31ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: e946a4548f114b088ac5073b28e31ba0 Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236367154 Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: c38435f90f9a4cceba68faec58e9a5e4 Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-AttachVolumeNegativeTest-236367154-project Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: > Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.821386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '03a463b3-7cdc-4aa4-b822-bc800a37d402'} Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:01.822365 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. Jun 24 10:47:01.823881 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:01.825515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] Returning 404 to user: Instance 03a463b3-7cdc-4aa4-b822-bc800a37d402 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:01.825515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-94e87132-b7d6-4559-9b0e-71341fd0cdaf tempest-AttachVolumeNegativeTest-236367154 tempest-AttachVolumeNegativeTest-236367154-project] 10.222.0.69 "GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402" status: 404 len: 111 microversion: 2.1 time: 0.029134 Jun 24 10:47:01.825515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 483/969] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:01 2022] GET /compute/v2.1/servers/03a463b3-7cdc-4aa4-b822-bc800a37d402 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:06.242575 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0794ad4a-af91-4340-9dc3-f9b99e8c5c38 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Action: 'create', calling method: .version_select at 0x7f17629c5160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1546151545", "metadata": {"Type": "work"}}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0794ad4a-af91-4340-9dc3-f9b99e8c5c38 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 122 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:06.257709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1546151545", "metadata": {"Type": "work"}}} Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:47:06.259367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1546151545', 'metadata': {'Type': 'work'}}}} Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.260343 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:47:06.262001 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:47:06.263400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:47:06.263400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.263400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-0794ad4a-af91-4340-9dc3-f9b99e8c5c38 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.263400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-0794ad4a-af91-4340-9dc3-f9b99e8c5c38 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146879 Jun 24 10:47:06.263400 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 487/970] 10.222.0.69 () {60 vars in 1155 bytes} [Fri Jun 24 10:47:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:47:06.269139 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e684950f-2320-4956-84d0-02edf7cc8273 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Action: 'create', calling method: .version_select at 0x7f17620321f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1890097999", "metadata": {"Type": "work"}}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e684950f-2320-4956-84d0-02edf7cc8273 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 120 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:06.272341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1890097999", "metadata": {"Type": "work"}}} Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: Jun 24 10:47:06.273867 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1890097999', 'metadata': {'Type': 'work'}}}} Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi '0' Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.275047 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:47:06.276636 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:47:06.278185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:47:06.278185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.278185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-e684950f-2320-4956-84d0-02edf7cc8273 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.278185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-e684950f-2320-4956-84d0-02edf7cc8273 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008631 Jun 24 10:47:06.278185 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 484/971] 10.222.0.69 () {60 vars in 1155 bytes} [Fri Jun 24 10:47:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:47:06.283335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-de0265f0-f85c-4d9f-85b3-f45e6eca426b tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Action: 'create', calling method: .version_select at 0x7f17628b35e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1739421159", "metadata": {"Type": "work"}}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-de0265f0-f85c-4d9f-85b3-f45e6eca426b tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 119 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:06.286610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1739421159", "metadata": {"Type": "work"}}} Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:47:06.288166 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1739421159', 'metadata': {'Type': 'work'}}}} Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi '' Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.289269 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:47:06.290874 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:47:06.292380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:47:06.292380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.292380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-de0265f0-f85c-4d9f-85b3-f45e6eca426b tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.292380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-de0265f0-f85c-4d9f-85b3-f45e6eca426b tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008489 Jun 24 10:47:06.292380 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 488/972] 10.222.0.69 () {60 vars in 1155 bytes} [Fri Jun 24 10:47:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:47:06.298261 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d3cb5c9b-8cea-49b3-9652-6434342d30ec tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Calling method '.version_select at 0x7f17623691f0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:06.327806 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-d3cb5c9b-8cea-49b3-9652-6434342d30ec tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] HTTP exception thrown: Volume tempest-invalid-1338700379 could not be found. Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d3cb5c9b-8cea-49b3-9652-6434342d30ec tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1338700379 HTTP/1.1 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:06.329791 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Volume tempest-invalid-1338700379 could not be found. Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': 'tempest-invalid-1338700379'} Jun 24 10:47:06.331310 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1338700379 could not be found. (HTTP 404) (Request-ID: req-7e9bc670-002b-43e5-bcd9-2d9035058153) Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.332287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:47:06.333560 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1338700379 could not be found. Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:06.334711 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1338700379 could not be found. Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1338700379 could not be found. Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d3cb5c9b-8cea-49b3-9652-6434342d30ec tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 404 to user: Volume tempest-invalid-1338700379 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d3cb5c9b-8cea-49b3-9652-6434342d30ec tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1338700379" status: 404 len: 99 microversion: 2.1 time: 0.037209 Jun 24 10:47:06.335919 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 485/973] 10.222.0.69 () {58 vars in 1217 bytes} [Fri Jun 24 10:47:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1338700379 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:47:06.342591 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a906099a-69d0-4d5e-90b1-0bbb64388a2d tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004337 Jun 24 10:47:06.343071 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 489/974] 10.222.0.69 () {58 vars in 1139 bytes} [Fri Jun 24 10:47:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 10:47:06.352388 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-093c0fe0-fa42-4ade-93e3-c5a7bf4612ce tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003820 Jun 24 10:47:06.352910 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 486/975] 10.222.0.69 () {58 vars in 1136 bytes} [Fri Jun 24 10:47:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 24 10:47:06.361486 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-23f889ff-ba8d-4665-9b78-39efdd51e3ea tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Calling method '.version_select at 0x7f17628b3040>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:06.391318 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-23f889ff-ba8d-4665-9b78-39efdd51e3ea tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] HTTP exception thrown: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-23f889ff-ba8d-4665-9b78-39efdd51e3ea tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: DELETE /compute/v2.1/os-volumes/a78a604a-6152-4e81-9f42-2d046a8d18f8 HTTP/1.1 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:47:06.393341 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'a78a604a-6152-4e81-9f42-2d046a8d18f8'} Jun 24 10:47:06.394688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. (HTTP 404) (Request-ID: req-24cbade1-d25d-41c4-b221-870744a3bc3e) Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.395642 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:47:06.397334 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:47:06.398809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-23f889ff-ba8d-4665-9b78-39efdd51e3ea tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 404 to user: Volume a78a604a-6152-4e81-9f42-2d046a8d18f8 could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-23f889ff-ba8d-4665-9b78-39efdd51e3ea tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/a78a604a-6152-4e81-9f42-2d046a8d18f8" status: 404 len: 109 microversion: 2.1 time: 0.037015 Jun 24 10:47:06.400477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 490/976] 10.222.0.69 () {58 vars in 1247 bytes} [Fri Jun 24 10:47:06 2022] DELETE /compute/v2.1/os-volumes/a78a604a-6152-4e81-9f42-2d046a8d18f8 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:06.407419 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2b2006ba-4c81-4f22-a50f-9a6d114258c3 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Calling method '.version_select at 0x7f1762477af0>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:06.435174 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.wsgi [None req-2b2006ba-4c81-4f22-a50f-9a6d114258c3 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] HTTP exception thrown: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2b2006ba-4c81-4f22-a50f-9a6d114258c3 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Request method failure captured: Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: request: GET /compute/v2.1/os-volumes/214b04cb-040c-4564-ad95-5676c82ec1a6 HTTP/1.1 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept: application/json Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Accept-Encoding: identity Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Connection: close Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Length: 0 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Content-Type: application/json Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Host: 10.222.0.69 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Openstack-System-Scope: None Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: User-Agent: python-urllib3/1.26.9 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Auth-Token: gAAAAABitZYqzTs9rHNtYYpp_h6KdOxGp-CbyZBUoH9HodWjYIo5Xm07fJQdXUUilX7_wmI217ybAfnNg9Ywz10gBa9yrKxCa6PH5l9iWGl-iRAmvEc5XWbVomcMp2ZC3F6tN8TAqe7X_1zzJmu1Qp8WvB4EBMrRRo0azt3hmFFY7ibUUj-MN6s Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Id: None Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Domain-Name: None Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Identity-Status: Confirmed Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Is-Admin-Project: True Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Id: default Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Domain-Name: Default Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Project-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Role: member,reader Jun 24 10:47:06.437214 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Roles: member,reader Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9e41a51a179b4371a2815bb2d02ea1d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9e41a51a179b4371a2815bb2d02ea1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Id: 9e41a51a179b4371a2815bb2d02ea1d7 Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-Tenant-Name: tempest-VolumesNegativeTest-474335154 Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Id: default Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Domain-Name: Default Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Id: 62527016dd54474dae5d1164f47b6d24 Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: X-User-Name: tempest-VolumesNegativeTest-474335154-project Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: method: Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: exception: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: action_args: {'id': '214b04cb-040c-4564-ad95-5676c82ec1a6'} Jun 24 10:47:06.438684 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. (HTTP 404) (Request-ID: req-85ced350-59b8-4098-a62a-dff28365a30e) Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.439501 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:47:06.440697 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:47:06.441949 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR nova.api.openstack.wsgi Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-2b2006ba-4c81-4f22-a50f-9a6d114258c3 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] Returning 404 to user: Volume 214b04cb-040c-4564-ad95-5676c82ec1a6 could not be found. {{(pid=124304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:47:06.443098 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-2b2006ba-4c81-4f22-a50f-9a6d114258c3 tempest-VolumesNegativeTest-474335154 tempest-VolumesNegativeTest-474335154-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/214b04cb-040c-4564-ad95-5676c82ec1a6" status: 404 len: 109 microversion: 2.1 time: 0.035726 Jun 24 10:47:06.443929 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 487/977] 10.222.0.69 () {58 vars in 1244 bytes} [Fri Jun 24 10:47:06 2022] GET /compute/v2.1/os-volumes/214b04cb-040c-4564-ad95-5676c82ec1a6 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:47:34.814058 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=20 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:34.814685 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:35.016397 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-aad146ee-6bb5-44d0-8d2f-8cc37d9d8092 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Action: 'create', calling method: .version_select at 0x7f17627da310>, body: {"keypair": {"name": "tempest-TestShelveInstance-131427163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKQSmo7DsdvhvGfbqC9PxiqYH280KfWIdz6LgIRtA52+vwBZCn0d5r4Vt7hW5AkSF7qrVTNzxRs1IH1PJYjmvt0ASzG9UqwXQqcukvNAc2XvylopP04N8xCoWab0zFIVg=="}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:35.032359 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-aad146ee-6bb5-44d0-8d2f-8cc37d9d8092 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Getting quotas for project 9d15300203df4c139c86b1ddf43f34c4. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:47:35.037548 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.quota [None req-aad146ee-6bb5-44d0-8d2f-8cc37d9d8092 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Getting quotas for user 75b2d6e8e9614ce49ed02d63493b6612 and project 9d15300203df4c139c86b1ddf43f34c4. Resources: {'key_pairs'} {{(pid=124303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:47:35.066584 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-aad146ee-6bb5-44d0-8d2f-8cc37d9d8092 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.259609 Jun 24 10:47:35.074422 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 491/978] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Jun 24 10:47:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:47:50.293553 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:50.294304 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:50.299135 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-695019993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-131427163", "security_groups": [{"name": "tempest-secgroup-smoke-422682939"}], "networks": [{"uuid": "2c9a9542-e6d7-40c4-9bb1-50f32b2c911e"}], "block_device_mapping_v2": [{"uuid": "ccbaf65f-2ab0-421e-9a7a-8258d058503f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:50.422140 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.network.neutron [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] validate_networks() for [('2c9a9542-e6d7-40c4-9bb1-50f32b2c911e', None, None, None, None, None)] {{(pid=124304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:47:51.169074 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Flavor limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:47:51.169491 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Image limits 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:47:51.169953 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Flavor pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:47:51.170351 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Image pref 0:0:0 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:47:51.170751 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.virt.hardware [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:47:51.180568 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:51.181040 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:51.181817 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:51.182251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:51.201378 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Getting quotas for project 9d15300203df4c139c86b1ddf43f34c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:47:51.205737 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.quota [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Getting quotas for user 75b2d6e8e9614ce49ed02d63493b6612 and project 9d15300203df4c139c86b1ddf43f34c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:47:51.268597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Going to run 1 instances... {{(pid=124304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:47:51.270849 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccbaf65f-2ab0-421e-9a7a-8258d058503f',volume_size=None,volume_type=None)] {{(pid=124304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:47:51.408602 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-c7056d33-cc9f-47b9-87db-7dd0d1ea0ab6 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117538 Jun 24 10:47:51.409339 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 488/979] 10.222.0.69 () {60 vars in 1146 bytes} [Fri Jun 24 10:47:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:47:51.420612 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b458a096-d1d4-4c26-977c-ab4ffe8b0866 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:51.421854 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b458a096-d1d4-4c26-977c-ab4ffe8b0866 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:51.424308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=4 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:51.424993 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:47:51.484214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b458a096-d1d4-4c26-977c-ab4ffe8b0866 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:51.491818 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b458a096-d1d4-4c26-977c-ab4ffe8b0866 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1087 microversion: 2.1 time: 0.075249 Jun 24 10:47:51.492399 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 492/980] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:51 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:52.509642 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:52.510253 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:52.516544 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:52.517018 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:52.517835 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:52.518268 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:52.600769 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:52.610923 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-d4f2e0ec-0456-4908-ac10-f16a13c0aeb0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1203 microversion: 2.1 time: 0.105691 Jun 24 10:47:52.622992 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 489/981] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:52 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1203 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:53.630500 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:53.631235 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:53.639648 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:53.640063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:53.640866 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:53.641594 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:53.848197 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:53.857706 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-463f71e3-dddc-4e47-8631-8bdc5b73adff tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.231098 Jun 24 10:47:53.858308 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 493/982] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:53 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:54.028685 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f71ad0d0-20bd-4843-b177-ffca5e49e357 req-178b4342-2cb5-45ba-aa10-225b2c3d0e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:47:54.037009 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f71ad0d0-20bd-4843-b177-ffca5e49e357 req-178b4342-2cb5-45ba-aa10-225b2c3d0e8a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:54.037443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f71ad0d0-20bd-4843-b177-ffca5e49e357 req-178b4342-2cb5-45ba-aa10-225b2c3d0e8a service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:54.049418 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f71ad0d0-20bd-4843-b177-ffca5e49e357 req-178b4342-2cb5-45ba-aa10-225b2c3d0e8a service nova] Creating event network-changed:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:47:54.054909 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f71ad0d0-20bd-4843-b177-ffca5e49e357 req-178b4342-2cb5-45ba-aa10-225b2c3d0e8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104887 Jun 24 10:47:54.055679 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 490/983] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:47:54.878265 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:54.879245 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:54.887206 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:54.887663 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:54.888442 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:54.888921 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:55.105935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:55.113962 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b6da191e-3e42-4af6-bf2a-039557329b60 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.242185 Jun 24 10:47:55.115146 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 494/984] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:54 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:56.136929 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:56.138107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:56.148099 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:56.148543 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:56.149333 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:56.149763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:56.298061 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:56.310414 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-139b5ca2-bec6-4e4c-811f-ddb5c1f97cd4 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.181104 Jun 24 10:47:56.311302 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 491/985] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:56 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:57.333935 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:57.334610 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:57.341300 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:57.341749 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:57.342513 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:57.342946 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:57.485736 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:57.494392 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-17cb0477-e514-4edf-b712-a8a98c487368 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.166791 Jun 24 10:47:57.494964 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 495/986] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:57 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:58.513460 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:58.514366 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:58.523941 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:58.524567 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:58.525678 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:58.526286 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:58.662057 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:58.669894 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f2ce4b5d-f8a6-4942-8ce1-a9d1a30f06a8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.162077 Jun 24 10:47:58.670437 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 492/987] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:58 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:47:59.691548 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:47:59.692603 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:47:59.704580 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:59.705364 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:59.706617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:47:59.707321 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:47:59.852931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:47:59.861491 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-24104414-eee2-42fc-a545-19c629b4b452 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.176969 Jun 24 10:47:59.862054 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 496/988] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:47:59 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:00.880702 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:00.881429 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:00.888843 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:00.889285 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:00.890035 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:00.890461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:01.034251 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:01.046305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8d5eb393-a7f7-4ee6-9e4f-803299226c0c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.170350 Jun 24 10:48:01.046963 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 493/989] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:00 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:02.065251 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:02.066038 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:02.068931 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell0:SELECT=2 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:48:02.075997 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:02.076574 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:02.077530 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:02.078074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:02.226625 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:02.234703 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1a1f19d0-c583-4998-97c3-53a0e489218c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.174300 Jun 24 10:48:02.235278 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 497/990] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:02 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:03.252778 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:03.253427 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:03.256805 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=2 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:48:03.257786 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell0:SELECT=6 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:48:03.263666 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:03.263666 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:03.264045 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:03.264579 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:03.401386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:03.409862 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-3fba99e1-573d-4621-9100-3278dd516fcf tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.161594 Jun 24 10:48:03.410454 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 494/991] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:03 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:04.430100 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:04.431403 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:04.442688 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:04.443444 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:04.444709 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:04.445477 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:04.582861 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:04.591112 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-76d491bf-14bd-4fb9-bcb3-e22d422bc4af tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.167578 Jun 24 10:48:04.592633 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 498/992] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:04 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:04.811111 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-f3d2e7fb-52d6-4fa3-aa6c-5c86ed7ecb8a req-84e2f831-ccc4-4ac0-b09d-81c89bcafa60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "name": "network-vif-plugged", "status": "completed", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:48:04.819246 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f3d2e7fb-52d6-4fa3-aa6c-5c86ed7ecb8a req-84e2f831-ccc4-4ac0-b09d-81c89bcafa60 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:04.819681 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-f3d2e7fb-52d6-4fa3-aa6c-5c86ed7ecb8a req-84e2f831-ccc4-4ac0-b09d-81c89bcafa60 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:04.832965 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-f3d2e7fb-52d6-4fa3-aa6c-5c86ed7ecb8a req-84e2f831-ccc4-4ac0-b09d-81c89bcafa60 service nova] Creating event network-vif-plugged:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:48:04.838019 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-f3d2e7fb-52d6-4fa3-aa6c-5c86ed7ecb8a req-84e2f831-ccc4-4ac0-b09d-81c89bcafa60 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137140 Jun 24 10:48:04.838722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 495/993] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:48:05.613229 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:05.614371 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:05.622872 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:05.623314 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:05.624085 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:05.624510 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:05.772274 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:05.780369 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-730c51c6-7fa0-44a1-a63a-7d0ab72158b0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1258 microversion: 2.1 time: 0.173736 Jun 24 10:48:05.780973 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 499/994] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:05 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:06.802997 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:06.804049 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:06.814855 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:06.815593 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:06.816903 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:06.817615 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:06.965314 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:06.976477 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-faeb01e4-8aa0-47cc-a648-83d32ed351a3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1442 microversion: 2.1 time: 0.181166 Jun 24 10:48:06.977331 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 496/995] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:06 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1442 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:06.994929 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:48:06.995543 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:48:07.002620 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:07.003071 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:07.003842 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:07.004283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:07.137905 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:48:07.145668 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6a90098b-4f33-498d-97bb-f4e02080dac0 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1442 microversion: 2.1 time: 0.156372 Jun 24 10:48:07.146212 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 500/996] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:48:06 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:48:08.822995 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [req-c8d90ec0-eba3-46d6-8ed6-1a2dc8cc1b76 req-97c7f9b5-614d-4737-965f-05ea83f5646d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:48:08.831597 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c8d90ec0-eba3-46d6-8ed6-1a2dc8cc1b76 req-97c7f9b5-614d-4737-965f-05ea83f5646d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:48:08.832032 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [req-c8d90ec0-eba3-46d6-8ed6-1a2dc8cc1b76 req-97c7f9b5-614d-4737-965f-05ea83f5646d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:48:08.843271 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.compute.server_external_events [req-c8d90ec0-eba3-46d6-8ed6-1a2dc8cc1b76 req-97c7f9b5-614d-4737-965f-05ea83f5646d service nova] Creating event network-changed:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:48:08.848754 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [req-c8d90ec0-eba3-46d6-8ed6-1a2dc8cc1b76 req-97c7f9b5-614d-4737-965f-05ea83f5646d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029456 Jun 24 10:48:08.849395 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 497/997] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:49:27.938228 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:49:27.938855 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:50:02.945662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=20 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:50:02.947080 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=48 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:50:02.953557 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:50:02.954396 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:02.965914 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:02.967025 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:02.967662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:02.968108 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:02.992522 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.objects.instance [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lazy-loading 'flavor' on Instance uuid e3da11be-0915-401e-b953-856b5d4cb4ac {{(pid=124303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:50:03.080963 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-b98d3ce4-5218-415c-ba70-2f18b9a47928 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "POST /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.138241 Jun 24 10:50:03.081615 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 501/998] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:50:02 2022] POST /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:50:03.088444 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b450eb60-0e92-4214-a58d-fe885cbf7bbd] AMQP server on 10.222.0.69:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 24 10:50:03.089130 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:50:03.089773 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=44 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:50:03.095125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:03.095807 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:03.103380 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:03.103824 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:03.104588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:03.105071 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:03.246339 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:03.258361 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-11424462-28ee-4e3b-a1a3-c1911cf58b62 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.171566 Jun 24 10:50:03.259043 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 498/999] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:03 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:04.276991 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:04.277754 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:04.285723 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:04.286372 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:04.287285 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:04.287718 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:04.434859 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:04.442953 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-1f7b479b-50ec-4358-aad5-18cdabe6eb83 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.170886 Jun 24 10:50:04.443504 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 502/1000] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:04 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:05.460125 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:05.460780 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:05.470511 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:05.470972 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:05.471763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:05.472205 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:05.478078 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [-] [b450eb60-0e92-4214-a58d-fe885cbf7bbd] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 36348. Jun 24 10:50:05.608287 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:05.616359 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-836ff181-8783-4077-9a5f-e9c761f58c12 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.160346 Jun 24 10:50:05.616956 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 499/1001] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:05 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:06.638255 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:06.639330 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:06.650272 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:06.651006 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:06.652253 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:06.653020 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:06.790662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:06.801050 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-04631842-747b-4040-a9e7-ab4a502cde23 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.169626 Jun 24 10:50:06.801595 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 503/1002] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:06 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:07.822431 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:07.823300 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:07.831479 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:07.831922 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:07.832669 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:07.833128 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:07.977301 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:07.988474 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-47abbf00-84fb-4601-aed9-ddbf3e9b4c0a tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.172457 Jun 24 10:50:07.989195 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 500/1003] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:07 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:09.013390 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:09.014775 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:09.026153 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:09.026909 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:09.028185 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:09.028955 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:09.182759 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:09.190830 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-a2146c10-301d-48d3-8839-2094da6317d3 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.184126 Jun 24 10:50:09.191377 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 504/1004] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:09 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:10.212820 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:10.213959 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:10.225705 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:10.226436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:10.227673 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:10.228381 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:10.370766 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:10.382690 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-78a89530-6276-427f-8b9e-ece48af7846d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.176195 Jun 24 10:50:10.383757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 501/1005] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:10 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:11.405979 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:11.406745 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:11.414366 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:11.414809 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:11.415566 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:11.415990 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:11.552288 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:11.560430 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-26eea85f-3382-4d45-a4f4-107a254881ba tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.159700 Jun 24 10:50:11.561043 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 505/1006] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:11 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:12.582219 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:12.582800 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:12.590541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:12.591042 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:12.591912 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:12.592400 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:12.738839 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:12.746971 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f3ab9c45-01d1-42ed-8d4a-89df47032218 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.171102 Jun 24 10:50:12.747515 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 502/1007] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:12 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:13.763797 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:13.764357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:13.771254 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:13.771938 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:13.772703 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:13.773157 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:13.908064 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:13.916248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-6864233c-19b5-4a33-8425-4c665fd69a7e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.156494 Jun 24 10:50:13.916840 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 506/1008] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:13 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:14.943593 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:14.944332 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:14.952958 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:14.953517 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:14.954461 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:14.954996 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:15.102181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:15.110259 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-dde3e394-bc6c-4ad2-ad0c-b7ba1fe80074 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.173064 Jun 24 10:50:15.110802 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 503/1009] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:14 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:16.130672 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:16.131367 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:16.138213 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:16.138657 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:16.139421 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:16.139853 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:16.279887 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:16.287786 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-ade3ed9b-453b-43f3-8e7d-c72a2cd8e2a5 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1507 microversion: 2.1 time: 0.162813 Jun 24 10:50:16.288357 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 507/1010] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:16 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:16.304502 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:50:16.305096 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:16.311816 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:16.312254 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:16.313046 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:16.313471 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:16.416249 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [aae81f28-6388-4cbe-9ca8-42d20217eb50] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 10:50:17.427051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [aae81f28-6388-4cbe-9ca8-42d20217eb50] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 36374. Jun 24 10:50:17.430622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-cc529402-dd69-4a0d-83de-bf401f92a649 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "POST /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac/action" status: 202 len: 0 microversion: 2.1 time: 1.130172 Jun 24 10:50:17.431341 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 504/1011] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Jun 24 10:50:16 2022] POST /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:50:17.439438 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:17.440056 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:17.447066 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:17.447511 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:17.448282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:17.448716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:17.620884 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:17.629061 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-d5058f3b-7a57-4ca8-8a0f-e07dd631d3b9 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1515 microversion: 2.1 time: 0.193446 Jun 24 10:50:17.629644 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 508/1012] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:17 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:18.647439 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:18.648051 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:18.655107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:18.655548 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:18.656305 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:18.656763 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:18.798534 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:18.806384 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-56f0573f-9059-4d3f-89f5-3aca0708806c tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1517 microversion: 2.1 time: 0.163975 Jun 24 10:50:18.806982 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 505/1013] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:18 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:19.162835 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-a5b78dab-94ac-49ee-866e-74c2474c58e6 req-42d33e66-b320-4653-9f76-6b8452ef6296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "name": "network-vif-unplugged", "status": "completed", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:50:19.174214 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-a5b78dab-94ac-49ee-866e-74c2474c58e6 req-42d33e66-b320-4653-9f76-6b8452ef6296 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:19.174742 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-a5b78dab-94ac-49ee-866e-74c2474c58e6 req-42d33e66-b320-4653-9f76-6b8452ef6296 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:19.187028 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-a5b78dab-94ac-49ee-866e-74c2474c58e6 req-42d33e66-b320-4653-9f76-6b8452ef6296 service nova] Creating event network-vif-unplugged:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:50:19.193111 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-a5b78dab-94ac-49ee-866e-74c2474c58e6 req-42d33e66-b320-4653-9f76-6b8452ef6296 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034607 Jun 24 10:50:19.193782 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 509/1014] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:50:19.828819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:19.830136 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:19.840888 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:19.841468 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:19.842582 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:19.843255 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:19.992819 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:20.005026 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-6c32db1b-82c5-4eca-adab-9dc353eca933 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.183507 Jun 24 10:50:20.005588 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 506/1015] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:19 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:21.028292 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:21.029506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:21.041151 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:21.041325 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:21.042678 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:21.043613 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:21.193039 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:21.200776 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-e6eaecc9-a14a-4885-8252-d12ce772e968 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.180773 Jun 24 10:50:21.201358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 510/1016] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:21 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:22.223852 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:22.224575 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:22.232667 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:22.233236 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:22.234109 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:22.234604 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:22.369107 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:22.377058 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-95236829-a720-4506-ae12-f72f2868709d tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.159950 Jun 24 10:50:22.377624 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 507/1017] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:22 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:23.397532 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:23.398165 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:23.405175 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:23.405619 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:23.406375 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:23.406803 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:23.543007 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:23.551362 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-f62ddf88-8510-4854-9bc9-371e7f43e3ab tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.159471 Jun 24 10:50:23.552412 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 511/1018] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:23 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:24.571833 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:24.572497 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:24.580278 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:24.580788 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:24.581622 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:24.582092 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:24.728064 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:24.740653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-f44dbe70-cae0-4fbb-b6d8-b0559367573f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.173640 Jun 24 10:50:24.741374 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 508/1019] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:24 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:25.762133 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:25.763015 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:25.773138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:25.773586 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:25.774358 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:25.774790 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:25.913834 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:25.922074 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-8f1d8c94-0fb0-4186-80a5-f633e36c0b63 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1573 microversion: 2.1 time: 0.167321 Jun 24 10:50:25.922662 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 512/1020] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:25 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:26.948538 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:50:26.949541 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:50:26.960436 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:26.960916 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:26.961674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:26.962103 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:27.102752 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:50:27.110586 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-1972cb52-b413-445b-981b-fb66bd895a08 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1560 microversion: 2.1 time: 0.168638 Jun 24 10:50:27.111443 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 509/1021] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:50:26 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:50:29.259138 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-f9b59079-6b61-4d2d-8efe-95b0c16a2b69 req-f474a623-2727-46fa-818f-6c8e4e29b734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "name": "network-vif-plugged", "status": "completed", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:50:29.269526 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f9b59079-6b61-4d2d-8efe-95b0c16a2b69 req-f474a623-2727-46fa-818f-6c8e4e29b734 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:50:29.269945 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f9b59079-6b61-4d2d-8efe-95b0c16a2b69 req-f474a623-2727-46fa-818f-6c8e4e29b734 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:50:29.285048 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-f9b59079-6b61-4d2d-8efe-95b0c16a2b69 req-f474a623-2727-46fa-818f-6c8e4e29b734 service nova] Creating event network-vif-plugged:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:50:29.290282 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-f9b59079-6b61-4d2d-8efe-95b0c16a2b69 req-f474a623-2727-46fa-818f-6c8e4e29b734 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Jun 24 10:50:29.291167 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 513/1022] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:50:36.796041 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:50:36.797118 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:50:43.946036 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:50:43.946702 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:50:59.960420 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:50:59.961091 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Fri Jun 24 10:50:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:51:37.770122 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_api:SELECT=26 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:37.771416 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG dbcounter [-] [124304] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:37.773479 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_api:SELECT=26 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:37.774289 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG dbcounter [-] [124303] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:51:37.775722 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:37.776318 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:51:37.778573 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-ccd44a9e-4c24-4303-adff-cc7ffcbd2906 req-2e098175-9f7a-49b3-9969-306dde7f4f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:51:37.784338 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:37.784885 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:37.785713 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:37.786209 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:37.789227 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ccd44a9e-4c24-4303-adff-cc7ffcbd2906 req-2e098175-9f7a-49b3-9969-306dde7f4f2d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:37.789672 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-ccd44a9e-4c24-4303-adff-cc7ffcbd2906 req-2e098175-9f7a-49b3-9969-306dde7f4f2d service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:37.802889 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-ccd44a9e-4c24-4303-adff-cc7ffcbd2906 req-2e098175-9f7a-49b3-9969-306dde7f4f2d service nova] Creating event network-changed:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:51:37.809063 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-ccd44a9e-4c24-4303-adff-cc7ffcbd2906 req-2e098175-9f7a-49b3-9969-306dde7f4f2d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Jun 24 10:51:37.810445 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 514/1023] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:51:37.814258 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Going to try to terminate instance {{(pid=124304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:51:37.909410 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8bf3818c-feff-4488-9851-9cb971a23d6f tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 204 len: 0 microversion: 2.1 time: 0.140855 Jun 24 10:51:37.910390 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 510/1024] 10.222.0.69 () {58 vars in 1238 bytes} [Fri Jun 24 10:51:37 2022] DELETE /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:51:37.923456 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:37.924819 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:51:37.936237 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:37.937283 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:37.938335 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:37.939025 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:38.160716 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.policy [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124303) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:51:38.173346 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-3e8ce798-9572-4155-bf51-9dba963d835e tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.256969 Jun 24 10:51:38.182937 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 515/1025] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:51:37 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:51:39.194830 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:39.195526 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:51:39.202736 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:39.203181 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:39.203944 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:39.204371 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:39.477642 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:51:39.485512 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-8a300887-c854-4d19-acb3-623f9da1d021 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1566 microversion: 2.1 time: 0.297177 Jun 24 10:51:39.486089 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 511/1026] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:51:39 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1566 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:51:39.917506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [req-f54443c7-80ba-418f-aef6-e25ba09d5e35 req-6c0f5b2c-32ac-48fe-90ce-5743301e4bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3da11be-0915-401e-b953-856b5d4cb4ac", "name": "network-vif-deleted", "tag": "45e86066-8f7d-47c4-85f1-11ef2c9c681a"}]} {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:51:39.925912 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f54443c7-80ba-418f-aef6-e25ba09d5e35 req-6c0f5b2c-32ac-48fe-90ce-5743301e4bc3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:39.926353 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [req-f54443c7-80ba-418f-aef6-e25ba09d5e35 req-6c0f5b2c-32ac-48fe-90ce-5743301e4bc3 service nova] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:39.937443 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.compute.server_external_events [req-f54443c7-80ba-418f-aef6-e25ba09d5e35 req-6c0f5b2c-32ac-48fe-90ce-5743301e4bc3 service nova] Creating event network-vif-deleted:45e86066-8f7d-47c4-85f1-11ef2c9c681a for instance e3da11be-0915-401e-b953-856b5d4cb4ac on hv-cinder-84753 Jun 24 10:51:39.942426 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [req-f54443c7-80ba-418f-aef6-e25ba09d5e35 req-6c0f5b2c-32ac-48fe-90ce-5743301e4bc3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088166 Jun 24 10:51:39.943046 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 516/1027] 10.222.0.69 () {64 vars in 1317 bytes} [Fri Jun 24 10:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:51:40.502892 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:40.503653 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.compute.api [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124304) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:51:40.511188 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:40.511644 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:40.512413 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:40.512873 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:40.547288 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:40.547757 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG oslo_concurrency.lockutils [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:40.548186 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.objects.instance [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lazy-loading 'fault' on Instance uuid e3da11be-0915-401e-b953-856b5d4cb4ac {{(pid=124304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:51:40.594158 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.policy [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b2d6e8e9614ce49ed02d63493b6612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d15300203df4c139c86b1ddf43f34c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124304) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:51:40.602797 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-762a28bd-25f6-428f-89ab-db6daf4d0e33 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 200 len: 1223 microversion: 2.1 time: 0.103929 Jun 24 10:51:40.603386 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 512/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:51:40 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:51:41.626352 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '>' {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:41.627484 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.compute.api [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [instance: e3da11be-0915-401e-b953-856b5d4cb4ac] Fetching instance by UUID {{(pid=124303) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:51:41.639290 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:41.640070 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:41.641365 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:51:41.642076 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG oslo_concurrency.lockutils [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Lock "e5c325af-f7fa-481f-b3fd-d4961ecadde3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:51:41.657291 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.wsgi [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] HTTP exception thrown: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Request method failure captured: Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: request: GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac HTTP/1.1 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept: application/json Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Accept-Encoding: identity Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Connection: close Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Length: 0 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Content-Type: application/json Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Host: 10.222.0.69 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Openstack-System-Scope: None Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: User-Agent: python-urllib3/1.26.9 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Auth-Token: gAAAAABitZZB9phzXP36ERXplXUnH5553ygwyewYhej6E2ecroUDfvVlBzrU7h_NUMiE3-Qtt2XRVkyFFel5_rhcmyqo8qT8AddGRUMoUd7K2sm2JiWq-iVZ-BnRkSecIxvmeSiS60mLvXaimYKm_rUEPQ5iLC8p34LUAOnv7drBTRfEjpIRgFE Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Id: None Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Domain-Name: None Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Identity-Status: Confirmed Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Is-Admin-Project: True Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Id: default Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Domain-Name: Default Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Id: 9d15300203df4c139c86b1ddf43f34c4 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Project-Name: tempest-TestShelveInstance-1130937588 Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Role: member,reader Jun 24 10:51:41.658900 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Roles: member,reader Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d15300203df4c139c86b1ddf43f34c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9d15300203df4c139c86b1ddf43f34c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9d15300203df4c139c86b1ddf43f34c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9d15300203df4c139c86b1ddf43f34c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}] Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant: tempest-TestShelveInstance-1130937588 Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Id: 9d15300203df4c139c86b1ddf43f34c4 Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-Tenant-Name: tempest-TestShelveInstance-1130937588 Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User: tempest-TestShelveInstance-1130937588-project Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Id: default Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Domain-Name: Default Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Id: 75b2d6e8e9614ce49ed02d63493b6612 Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: X-User-Name: tempest-TestShelveInstance-1130937588-project Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: method: > Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: exception: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. Jun 24 10:51:41.661395 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: action_args: {'id': 'e3da11be-0915-401e-b953-856b5d4cb4ac'} Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: {{(pid=124303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:51:41.662617 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. Jun 24 10:51:41.664248 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: ERROR nova.api.openstack.wsgi Jun 24 10:51:41.665681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: DEBUG nova.api.openstack.wsgi [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Returning 404 to user: Instance e3da11be-0915-401e-b953-856b5d4cb4ac could not be found. {{(pid=124303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:51:41.665681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO nova.api.openstack.requestlog [None req-87ecb224-b176-4a66-ba5e-af941e3b7719 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac" status: 404 len: 111 microversion: 2.1 time: 0.041817 Jun 24 10:51:41.665681 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: [pid: 124303|app: 0|req: 517/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Fri Jun 24 10:51:41 2022] GET /compute/v2.1/servers/e3da11be-0915-401e-b953-856b5d4cb4ac => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:51:42.094936 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: DEBUG nova.api.openstack.wsgi [None req-55f2592d-a3a2-4105-9ff3-3a4f4c6b7ac8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] Calling method '.version_select at 0x7f17622fb940>' {{(pid=124304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:51:42.098146 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55f2592d-a3a2-4105-9ff3-3a4f4c6b7ac8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [a686f187-56fb-4ed6-8e0d-ff0c55feeff4] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 10:51:43.113084 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [None req-55f2592d-a3a2-4105-9ff3-3a4f4c6b7ac8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] [a686f187-56fb-4ed6-8e0d-ff0c55feeff4] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 36474. Jun 24 10:51:43.140224 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO nova.api.openstack.requestlog [None req-55f2592d-a3a2-4105-9ff3-3a4f4c6b7ac8 tempest-TestShelveInstance-1130937588 tempest-TestShelveInstance-1130937588-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131427163" status: 202 len: 0 microversion: 2.1 time: 1.049498 Jun 24 10:51:43.140809 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: [pid: 124304|app: 0|req: 513/1030] 10.222.0.69 () {58 vars in 1250 bytes} [Fri Jun 24 10:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-131427163 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:53:56.809169 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:53:56.810221 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:54:03.956468 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:54:03.957516 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:54:19.970782 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:54:19.971746 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Fri Jun 24 10:54:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:54:27.950763 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:54:27.951506 dv-cinder-847536-1-iscsi devstack@n-api.service[124303]: Fri Jun 24 10:54:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:55:51.618674 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:55:51.619556 dv-cinder-847536-1-iscsi devstack@n-api.service[124304]: Fri Jun 24 10:55:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!